-- Logs begin at Mon 2022-06-27 14:41:22 UTC, end at Mon 2022-06-27 15:47:33 UTC. -- Jun 27 15:17:43.017256 dv-cinder-847798-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 15:17:43.026659 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 15:17:43 2022] *** Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: nodename: dv-cinder-847798-1-iscsi Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: machine: x86_64 Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: clock source: unix Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: pcre jit disabled Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: detected number of CPU cores: 4 Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: current working directory: / Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: detected binary path: /usr/bin/uwsgi-core Jun 27 15:17:43.028730 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: your processes number limit is 47680 Jun 27 15:17:43.029384 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: your memory page size is 4096 bytes Jun 27 15:17:43.029384 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: detected max file descriptor number: 2048 Jun 27 15:17:43.029384 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: lock engine: pthread robust mutexes Jun 27 15:17:43.029384 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: thunder lock: enabled Jun 27 15:17:43.029384 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 15:17:43.029384 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 15:17:43.073054 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: Python main interpreter initialized at 0x563536aa69c0 Jun 27 15:17:43.073054 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: python threads support enabled Jun 27 15:17:43.073054 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: your server socket listen backlog is limited to 100 connections Jun 27 15:17:43.073054 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: your mercy for graceful operations on workers is 90 seconds Jun 27 15:17:43.073458 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 15:17:43.073458 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: *** Operational MODE: preforking *** Jun 27 15:17:43.073740 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: *** uWSGI is running in multiple interpreter mode *** Jun 27 15:17:43.073740 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: spawned uWSGI master process (pid: 103257) Jun 27 15:17:43.076854 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: spawned uWSGI worker 1 (pid: 103281, cores: 1) Jun 27 15:17:43.076854 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: spawned uWSGI worker 2 (pid: 103282, cores: 1) Jun 27 15:17:43.076854 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 15:17:43.073953 dv-cinder-847798-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 15:17:43.739883 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 15:17:43.761935 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 15:17:44.885184 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:17:44.885184 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: from cryptography.utils import int_from_bytes Jun 27 15:17:44.885818 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:17:44.885818 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: from cryptography.utils import int_from_bytes Jun 27 15:17:44.894834 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:17:44.894834 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: from cryptography.utils import int_from_bytes Jun 27 15:17:44.895332 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:17:44.895332 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: from cryptography.utils import int_from_bytes Jun 27 15:17:47.424283 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 15:17:47.424918 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 15:17:47.425265 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 15:17:47.425360 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 15:17:47.425437 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 15:17:47.425503 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 15:17:47.425565 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 15:17:47.425636 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 15:17:47.425709 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 15:17:47.425874 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 15:17:47.426103 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.426243 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.426391 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.426522 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.426743 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.426884 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.427039 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.427173 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.427396 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.427542 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.427703 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.427832 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.428031 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.428160 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.428335 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.428431 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.428713 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.428843 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.428943 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.429031 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.429251 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.429393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.429598 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847798-1-iscsi {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.429738 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847798-1-iscsi {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.429919 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.430066 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.430203 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.430312 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.430538 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.430669 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.430853 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.431001 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.431141 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.431237 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.431459 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.431546 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.431767 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.431861 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.432264 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.433697 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.433697 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.433962 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.434098 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.434257 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.434394 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.434562 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.434562 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.434759 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.434921 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.434989 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.434989 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.435108 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.435108 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.435245 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.435331 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.435415 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.435497 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.435573 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.435652 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.435736 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.436013 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847798-1-iscsi {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.436163 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847798-1-iscsi {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.436339 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.436438 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.436658 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.436759 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.436976 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.437129 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.437392 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.437540 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.437692 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.437830 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.438012 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.438137 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.438332 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.438465 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.438664 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.438802 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.438960 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.439083 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.439298 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.439427 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.439613 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.439746 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.439935 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.440060 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.440255 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.440400 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.440585 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.440710 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.440897 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.441029 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.441203 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.441327 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.441523 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.441647 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.441825 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.441949 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.442115 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.442607 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.442736 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.442857 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.443042 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.443175 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.443360 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.443493 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.443687 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.443811 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.444005 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.444133 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.444264 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.444424 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.444558 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.444687 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.444808 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.444927 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.445148 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.445285 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.445434 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.445558 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.445751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.445875 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.446090 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.446225 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.446354 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.446474 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.446654 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.446794 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.446968 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.447108 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.447228 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.447352 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.447552 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.447856 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.447856 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.448106 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.448232 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.448424 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.448533 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.448647 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.448778 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.448895 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.449113 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.449247 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.449512 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.449645 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.449798 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.449980 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.450183 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.450290 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.450429 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.450565 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.450762 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.450889 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.451074 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.451201 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.451385 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.451518 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.451701 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.451826 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.452007 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.452142 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.452296 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.452513 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.452646 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.452765 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.452950 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.453081 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.453287 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.453419 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.453590 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.453715 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.453840 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.453957 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.454133 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.454258 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.454431 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.454554 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.454748 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.454882 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.455054 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.455185 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.455366 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.455491 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.455662 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.455795 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.455969 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.456092 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.456297 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.456439 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.456589 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.456731 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.456904 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.457028 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.457209 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.457332 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.457513 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.457646 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.457827 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.457959 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.458091 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.458215 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.458415 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.458549 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.458724 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.458855 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.459032 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.459156 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.459352 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.459476 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.459655 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.459778 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.459961 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.460085 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.460285 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.460456 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.460594 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.460723 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.460891 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.461024 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.461197 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.461329 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.461489 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.461608 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.461808 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.461933 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.462111 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.462235 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.462415 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.462538 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.462736 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.462860 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.463041 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.463165 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.463348 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.463472 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.463664 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.463798 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.463956 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.464090 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.464278 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.464440 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.464612 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.464743 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.464907 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.465031 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.465217 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.465348 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.465617 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.465754 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.465924 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.466050 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.466231 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.466428 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.466553 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.466689 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.466809 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.466966 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.467100 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.467287 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.467413 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.467593 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.467720 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.467912 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.468040 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.468285 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.468456 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.468587 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.468715 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.468865 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.469000 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.469177 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.469303 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.469504 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:17:47.469631 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.469848 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.469974 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.470184 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.470319 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.470498 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.470629 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.470834 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.470961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.471164 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.471304 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.471486 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.471611 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.471795 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.471921 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.472095 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.472219 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.472436 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.472559 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.472757 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.472893 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.473051 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.473194 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.473363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.473493 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.473681 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.473809 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.473997 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.474119 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.474317 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.474449 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.474630 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.474759 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.474946 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.475076 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.475266 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.475389 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.475577 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.475699 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.475898 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.476030 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.476221 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.476378 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.476582 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.476711 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.476875 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.476999 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.477200 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.477321 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.477547 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.477672 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.477863 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.477992 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.478191 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.478313 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.478516 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.478648 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.478829 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.478951 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.479141 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.479265 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.479451 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.479583 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.479763 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.479890 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.480088 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.480211 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.480422 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.480560 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.480742 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.480865 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.481138 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.481258 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.481500 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.481712 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.481859 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.481989 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.482175 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.482297 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.482492 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.482625 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.482836 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.482959 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.483156 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.483285 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.483474 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.483597 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.483786 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.483922 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.484106 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.484242 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.484447 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.484596 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.484764 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.484916 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.485079 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.485234 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.485372 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.485558 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.485682 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.485866 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.485996 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.486175 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.486310 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.486474 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.486607 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.486799 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.486924 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.487079 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.487203 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.487403 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.487526 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.487735 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.487859 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.488231 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.488417 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.488555 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.488687 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.488816 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.488937 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.489067 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.489187 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.489313 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.489432 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.489606 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.489736 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.489916 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.490047 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.490222 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.490346 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.490533 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.490667 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.490843 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.490973 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.491148 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.491269 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.491472 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.491603 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.491780 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.491902 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.492085 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.492209 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.492422 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.492560 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.492734 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.492855 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.493045 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.493168 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.493358 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.493488 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.493668 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.493791 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.493982 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.494104 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.494297 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.494421 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.494608 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.494729 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.494930 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.495051 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.495249 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.495375 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.495564 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.495685 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.495893 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.496016 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.496208 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.496370 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.496551 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.496684 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.496936 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.497063 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.497312 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.497451 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.497661 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.497797 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.497970 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.498095 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.498278 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.498395 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.498582 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.498706 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.498887 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.499022 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.499194 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.499323 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.499504 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.499625 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.499812 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.499949 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.500115 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.500224 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.500449 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.500590 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.500757 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.500889 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.501082 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.501202 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.501384 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.501515 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.501692 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.501803 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.501995 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.502117 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.502302 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.502423 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.502647 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.502759 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.502959 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.503083 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.503295 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.503415 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.503620 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.503731 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.503936 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.504060 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.504254 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.504414 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.504593 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.504731 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.504907 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.505028 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.505219 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.505349 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.505533 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.505654 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.505849 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.505970 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.506161 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.506325 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.506482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.506605 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.506795 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.506919 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.507117 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.507246 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.507428 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.507561 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.507769 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.507893 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.508043 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.508179 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.508392 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.508522 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.508694 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.508814 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.509016 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.509140 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.509351 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.509478 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.509674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.509804 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.509985 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.510109 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.510300 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.510430 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.510609 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.510738 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.510941 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.511062 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.511216 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.511346 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.511527 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.511648 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.511841 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.511962 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.512148 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.512276 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.512553 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.512675 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.512950 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.513072 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.513191 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.513317 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.513478 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.513610 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.513797 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.513918 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.514104 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.514226 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.514419 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.514549 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.514726 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.514847 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.515045 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.515167 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.515370 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.515499 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.515682 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.515803 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.516003 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.516123 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.516345 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.516488 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.516647 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.516767 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.516960 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.517081 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.517269 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.517394 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.517573 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.517697 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.517883 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.518003 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.518191 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.518314 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.518515 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.518651 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.518806 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.518928 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.519118 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.519240 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.519431 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.519678 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.519800 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.520041 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.520236 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.520395 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.520674 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.520853 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.520975 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.521282 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.521412 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.521610 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.521920 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.522043 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.522244 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.522373 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.522570 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.522693 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.522880 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.523001 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.523186 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.523317 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.523514 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.523635 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.523823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.523946 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.524128 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.524260 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.524459 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.524582 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.524765 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.524999 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.525134 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.525417 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.525596 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.525719 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.525975 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.526097 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.526329 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.526451 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.526638 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.526760 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.526948 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.527069 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.527259 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.527381 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.527571 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.527694 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.527915 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.528053 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.528282 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.528499 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.528825 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.528944 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.529077 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.529216 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.529336 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.529465 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.529584 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.529700 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.529831 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.530083 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.530208 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.530459 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.530685 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.530806 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.531075 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.531234 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.531384 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.531697 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.531817 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.532018 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.532405 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.532648 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.532990 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.533112 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.533313 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.533436 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.533635 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.533767 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.533962 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.534087 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.534285 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.534406 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.534622 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.534745 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.534954 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.535085 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.535312 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.535545 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.535681 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.535891 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.536015 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.536216 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.536408 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.536531 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.536648 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.536852 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.536976 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.537165 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.537287 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.537475 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.537596 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.537784 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.537907 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.538097 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.538220 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.538423 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.538553 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.538697 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.539004 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.539135 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.539310 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.539627 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.539747 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.539933 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.540247 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.540384 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.540580 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.540805 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.540927 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.541210 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.541356 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.541514 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.541817 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.541938 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.542120 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.542251 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.542459 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.542567 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.542764 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.542886 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.543071 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.543201 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.543379 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.543542 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.543749 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.544013 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.544136 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.544477 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.544617 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.544752 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.544874 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.545018 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.545156 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.545334 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.545455 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.545643 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.545768 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.545948 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.546080 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.546255 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.546377 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.546566 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.546727 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.546870 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.547001 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.547168 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.547300 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.547485 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.547695 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.547844 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.547974 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.548109 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.548230 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.548409 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.548534 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.548720 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.548852 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.549069 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.549193 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.549320 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.549449 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.549634 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.549757 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.549941 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.550064 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.550250 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.550403 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.550574 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.550698 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.550858 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.550988 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.551161 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.551284 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.551468 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.551589 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.551771 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.551901 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.552080 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.552209 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.552407 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.552533 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.552716 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.552838 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.553019 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.553149 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.553329 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.553449 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.553633 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.553753 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.553937 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.554067 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.554239 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.554369 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.554550 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.554671 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.554857 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.554986 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.555158 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.555279 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.555468 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.555588 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.555769 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.555890 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.556073 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.556195 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.556402 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.556537 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.556709 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.556838 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.557007 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.557178 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.557308 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.557430 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.557602 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.557725 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.557906 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.558027 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.558213 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.558347 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.558520 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.558630 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.558822 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.558939 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.559227 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.559542 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.559687 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.559808 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.559917 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.560018 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.560232 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.560482 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.560635 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.560782 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.560950 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.561087 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.561393 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.561605 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.561755 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.561904 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.562049 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.562173 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.562291 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.562428 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.562557 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.562677 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.562796 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.562899 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.563009 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.563178 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.563288 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.563492 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.563609 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.563811 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.563942 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.564136 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.564257 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.564465 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.564589 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.564790 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.564971 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.565141 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.565278 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.565396 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.565516 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.565689 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.565859 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.566028 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.566204 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.566338 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.566455 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.566658 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.566781 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.566891 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.567017 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.567583 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.567700 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.567902 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.568072 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.568218 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.568495 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.568624 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.568773 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.568918 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.569046 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.569167 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.569308 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.569550 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.569707 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.569875 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.570054 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.570168 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.570338 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.570486 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.570642 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.570822 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.570992 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.571159 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.571330 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.571467 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.571597 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.571716 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.571835 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.571952 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.572069 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.572186 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.572312 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.572485 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.572607 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.572816 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.572939 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.573123 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.573273 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.573436 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.573557 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.573800 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.573972 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.574146 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.574277 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.574404 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.574523 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.574658 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.574871 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.575057 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.575225 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.575346 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.575470 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.575613 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.575743 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.575920 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.576045 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.576256 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.576424 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.576595 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.576729 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.576910 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.577027 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.577222 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.577356 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.577526 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.577695 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.577856 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.577968 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.578174 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.578296 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.578492 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.578669 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.578817 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.578924 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.579159 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.579268 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.579523 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.579751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.579868 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.579979 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.580082 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.580266 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.580404 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.580575 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.580708 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.580889 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.581022 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.581199 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.581352 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.581546 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.581691 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.581869 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.581978 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.582186 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.582311 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.582505 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.582616 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.582820 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.582954 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.583148 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.583297 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.583539 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.583669 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.583853 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.583989 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.584158 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.584294 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.584470 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.584598 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.584778 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.584915 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.585092 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.585236 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.585419 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.585556 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.585724 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.585847 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.586030 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.586154 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.586334 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.586470 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.586658 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.586781 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.586964 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.587098 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.587288 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.587410 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.587692 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.587813 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.588007 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.588152 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.588402 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.588525 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.588758 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.588888 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.589009 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.589137 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.589266 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.589386 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.589562 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.589693 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.589896 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.590019 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.590268 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.590640 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.590863 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.590978 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.591247 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.591386 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.591507 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.591631 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.591751 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.591869 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.591987 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.592118 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.592239 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.592377 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.592512 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.592632 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.592781 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.592913 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.593130 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.593261 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.593494 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.593651 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.593771 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.593901 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.594050 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.594181 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.594365 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.594571 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.594707 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.594901 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.595023 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.595214 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.595336 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.595543 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.595673 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.595872 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.596001 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.596182 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.596303 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.596515 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.596651 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.596829 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.596951 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.597136 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.597251 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.597443 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.597573 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.597766 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.597888 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.598071 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.598193 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.598378 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.598498 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.598684 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.598806 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.598990 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.599113 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.599293 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.599422 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.599595 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.599717 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.599955 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.600087 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.600218 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.600368 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.600560 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.600682 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.600876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.601009 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.601201 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.601325 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.601521 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.601642 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.601827 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.601957 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.602153 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.602276 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.602469 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.602598 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.602775 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.602899 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.603076 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.603201 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.603378 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.603500 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.603683 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.603812 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.603991 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.604125 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.604298 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.604479 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.604634 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.604770 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.604948 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.605078 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.605255 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.605380 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.605560 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.605691 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.605886 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.606039 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.606253 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.606556 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.606556 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.606908 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.606908 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.607153 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.607272 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.607388 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.607516 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.607635 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.607767 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.607957 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.608079 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.608196 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.608359 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.608495 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.608666 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.608790 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.608978 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.609109 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.609283 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.609405 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.609586 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.609717 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.609889 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.610036 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.610227 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.610359 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.610506 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.610630 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.610830 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.610961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.611144 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.611266 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.611451 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.611573 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.611757 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.611896 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.612062 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.612184 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.612440 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.612566 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.612994 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.613388 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.613388 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.613627 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.613749 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.613866 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.613994 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.614110 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.614110 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.614333 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.614450 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.614567 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.614693 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.614876 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.615001 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.615196 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.615319 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.615514 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.615649 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.615827 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.615948 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.616143 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.616263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.616485 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.616616 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.616799 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.616921 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.617107 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.617237 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.617420 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.617542 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.617733 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.617854 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.618051 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.618172 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.618379 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.618616 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.618739 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.618950 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.619081 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.619267 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.619398 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.619582 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.619704 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.619896 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.620019 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.620285 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.620466 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.620592 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.620723 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.620844 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.620975 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.621146 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.621270 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.621456 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.621578 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.621784 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.621952 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.622098 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.622212 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.622477 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.622601 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.622794 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.622926 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.623112 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.623236 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.623428 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.623560 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.623741 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.623865 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.624059 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.624184 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.624394 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.624521 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.624730 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.624862 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.625062 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.625183 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.625373 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.625506 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.625687 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.625810 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.626003 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.626126 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.626320 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.626451 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.626632 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.626853 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.626985 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.627171 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.627294 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.627509 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.627634 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.627837 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.627961 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.628144 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.628266 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.628496 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.628622 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.628814 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.628937 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.629143 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.629274 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.629453 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.629583 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.629763 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.629885 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.630076 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.630209 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.630428 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.630569 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.630689 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.630816 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.631005 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.631223 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.631347 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.631543 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.631675 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.631879 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.632000 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.632210 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.632397 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.632567 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.632773 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.632897 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.633134 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.633259 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.633458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.633581 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.633795 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.633927 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.634099 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.634222 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.634413 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.634544 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.634726 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.634859 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.635032 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.635156 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.635355 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.635485 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.635664 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.635787 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.635987 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.636116 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.636275 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.636415 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.636611 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.636746 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.636916 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.637155 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.637303 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.637601 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.637734 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.637912 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.638097 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.638221 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.638437 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.638560 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.638773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.638904 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.639099 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.639229 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.639413 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.639537 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.639721 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.639851 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.640035 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.640157 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.640364 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.640504 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.640849 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.640986 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.641108 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.641226 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.641344 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.641462 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.641590 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.641709 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.641850 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.641973 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.642163 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.642285 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.642469 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.642600 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.642783 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.642906 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.643088 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.643211 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.643398 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.643522 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.643754 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.643878 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.644084 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.644217 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.644416 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.644541 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.644732 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.644855 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.645041 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.645172 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.645349 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.645472 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.645657 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.645780 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.645971 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.646102 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.646283 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.646403 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.646587 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.646707 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.646899 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.647033 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.647205 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.647481 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.647611 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.647808 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.647937 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.648118 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.648241 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.648480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.648603 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.648816 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.648962 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.649125 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.649257 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.649429 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.649551 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.649736 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.649867 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.650045 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.650174 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.650364 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.650487 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.650749 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.650889 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.651012 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.651129 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.651285 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.651408 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.651594 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.651718 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.651904 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.652166 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.652289 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.652535 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.652672 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.652845 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.653199 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.653306 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.653438 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.653549 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.653774 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.653904 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.654023 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.654141 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.654268 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.654444 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.654562 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.654769 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.654893 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.655082 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.655205 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.655394 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.655519 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.655707 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.655839 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.656022 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.656145 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.656374 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.656516 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.656668 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.656794 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.656979 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.657113 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.657289 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.657412 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.657597 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.657726 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.657906 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.658039 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.658218 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.658342 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.658526 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.658648 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.658833 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.658970 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.659148 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.659273 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.659493 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.659617 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.659816 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.659941 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.660135 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.660267 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.660478 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.660589 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.660875 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.661022 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.661129 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.661255 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.661439 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.661562 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.661762 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.661885 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.662099 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.662218 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.662444 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.662568 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.662778 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.662907 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.663094 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.663222 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.663401 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.663530 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.663707 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.663834 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.664017 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.664139 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.664357 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.664501 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.664685 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.664814 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.664997 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.665119 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.665305 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.665504 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.665631 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.665749 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.665908 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.666029 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.666213 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.666335 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.666520 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.666650 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.666826 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.666947 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.667132 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.667256 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.667442 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.667562 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.667747 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.667894 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.668049 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.668203 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.668414 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.668609 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.668734 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.668871 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.669029 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.669182 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.669334 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.669541 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.669674 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.669901 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.670024 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.670211 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.670332 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.670517 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.670649 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.670820 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.670956 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.671156 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.671278 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.671419 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.671542 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.671724 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.671847 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.672028 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.672150 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.672366 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.672508 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.672674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.672806 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.672999 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.673122 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.673326 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.673526 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.673649 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.673758 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.673960 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.674094 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.674273 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.674451 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.674590 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.674804 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.674937 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.675057 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.675183 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.675313 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.675455 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.675578 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.675761 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.675890 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.676064 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.676202 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.676423 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.676548 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.676737 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.676860 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.677067 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.677189 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.677393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.677514 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.677702 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.677826 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.678024 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.678145 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.678336 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.678458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.678655 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.678777 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.678976 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.679100 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.679291 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.679413 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.679602 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.679737 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.679928 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.680050 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.680242 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.680450 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.680575 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.680707 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.680881 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.681004 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.681207 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.681347 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.681498 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.681631 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.681810 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.681935 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.682139 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.682262 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.682469 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.682591 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.682778 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.682939 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.683107 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.683276 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.683473 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.683635 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.683759 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.683869 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.684131 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.684276 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.684544 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.684676 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.684873 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.685031 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.685195 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.685335 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.685509 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.685632 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.685819 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.685942 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.686069 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103281) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 15:17:47.686222 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.686511 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.686832 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.687151 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.687482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.687812 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.688127 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.688493 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.688824 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.689182 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.689497 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.689846 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.690177 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.690494 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.690809 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.691117 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:17:47.691365 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103282) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 15:17:47.749791 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO dbcounter [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Registered counter for database nova_api Jun 27 15:17:47.851837 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO dbcounter [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Registered counter for database nova_api Jun 27 15:17:47.867556 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_db.sqlalchemy.engines [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:17:47.874488 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG oslo_db.sqlalchemy.engines [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:17:47.876096 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writer thread running {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:17:47.881696 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writer thread running {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:17:47.941030 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.context [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3576ccde-37ef-449d-b98e-5672f36557b1(cell1) {{(pid=103281) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 15:17:47.941494 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.context [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3576ccde-37ef-449d-b98e-5672f36557b1(cell1) {{(pid=103282) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 15:17:47.945855 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG oslo_concurrency.lockutils [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:17:47.946178 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:17:47.947456 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG oslo_concurrency.lockutils [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:17:47.947787 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:17:47.948263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG oslo_concurrency.lockutils [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:17:47.948623 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:17:47.950286 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG oslo_concurrency.lockutils [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103282) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:17:47.951364 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:17:47.952342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO dbcounter [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Registered counter for database nova_cell0 Jun 27 15:17:47.953443 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO dbcounter [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Registered counter for database nova_cell0 Jun 27 15:17:47.956492 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO dbcounter [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Registered counter for database nova_cell1 Jun 27 15:17:47.957431 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO dbcounter [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Registered counter for database nova_cell1 Jun 27 15:17:47.963522 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG oslo_db.sqlalchemy.engines [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:17:47.965351 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_db.sqlalchemy.engines [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:17:47.968834 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writer thread running {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:17:47.972976 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_db.sqlalchemy.engines [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:17:47.975011 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writer thread running {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:17:48.104100 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG oslo_db.sqlalchemy.engines [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:17:48.109801 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writer thread running {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:17:48.119170 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writer thread running {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:17:48.119366 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO dbcounter [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Registered counter for database nova_cell0 Jun 27 15:17:48.128619 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG oslo_db.sqlalchemy.engines [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103282) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:17:48.129886 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO dbcounter [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Registered counter for database nova_cell0 Jun 27 15:17:48.133948 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writer thread running {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:17:48.139295 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_db.sqlalchemy.engines [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103281) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:17:48.144154 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writer thread running {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:17:48.484419 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: WARNING keystonemiddleware.auth_token [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:17:48.492059 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: WARNING keystonemiddleware.auth_token [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:17:48.492241 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: WARNING keystonemiddleware.auth_token [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:17:48.499766 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: WARNING keystonemiddleware.auth_token [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:17:48.838899 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: WARNING keystonemiddleware.auth_token [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:17:48.845487 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: WARNING keystonemiddleware.auth_token [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:17:48.848825 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: WARNING keystonemiddleware.auth_token [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:17:48.850649 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563536aa69c0 pid: 103281 (default app) Jun 27 15:17:48.853276 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:17:48.854450 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001973 Jun 27 15:17:48.854893 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Mon Jun 27 15:17:48 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:17:48.855241 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: WARNING keystonemiddleware.auth_token [None req-3172c174-4d5c-4ecd-8fa8-d58279d987c8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:17:48.861254 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x563536aa69c0 pid: 103282 (default app) Jun 27 15:19:10.153365 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:10.155255 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002565 Jun 27 15:19:10.155859 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:10.174270 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_api:SELECT=3 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:10.175986 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_cell1:SELECT=3 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:10.177012 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_cell0:SELECT=3 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:10.177886 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:10.634952 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-1d91d88c-de25-4028-90f1-83fd57606c53 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:10.666328 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-1d91d88c-de25-4028-90f1-83fd57606c53 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.502709 Jun 27 15:19:10.667246 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jun 27 15:19:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:19:12.760148 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:12.761709 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-dd32a44a-7b83-4afb-a832-90f336fa4df5 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001712 Jun 27 15:19:12.762634 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:12.829423 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-73455734-1d76-486c-9a52-771910984466 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "c1", "vcpus": 1, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "swap": 0, "ram": 256, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:12.848359 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:19:12.848359 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: warnings.warn(msg) Jun 27 15:19:12.885171 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-73455734-1d76-486c-9a52-771910984466 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.112782 Jun 27 15:19:12.885731 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jun 27 15:19:12 2022] POST /compute/v2.1/flavors => generated 407 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:19:12.900012 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writing DB stats nova_api:SELECT=3 {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:12.900929 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writing DB stats nova_cell0:SELECT=3 {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:12.901676 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writing DB stats nova_cell1:SELECT=3 {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:12.902542 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:19:13.107816 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-ecd7a688-3234-47c7-a421-0e3f0ec827a6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:13.110288 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:19:13.110288 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: warnings.warn(msg) Jun 27 15:19:13.177323 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-ecd7a688-3234-47c7-a421-0e3f0ec827a6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282794 Jun 27 15:19:13.178119 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jun 27 15:19:12 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:19:15.285926 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-73455734-1d76-486c-9a52-771910984466 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:15.286987 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-73455734-1d76-486c-9a52-771910984466 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 27 15:19:15.287411 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:15.404628 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-e304f1b3-3b74-480a-85dc-bdd1086db70e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "ram": 512, "name": "ds512M", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:15.423168 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:19:15.423168 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: warnings.warn(msg) Jun 27 15:19:15.443344 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-e304f1b3-3b74-480a-85dc-bdd1086db70e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.149016 Jun 27 15:19:15.444018 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jun 27 15:19:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:19:15.456089 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-0635012b-78e1-42db-b15c-f1235ab49e70 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:15.457665 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:19:15.457665 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: warnings.warn(msg) Jun 27 15:19:15.491869 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-0635012b-78e1-42db-b15c-f1235ab49e70 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039593 Jun 27 15:19:15.492760 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jun 27 15:19:15 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:19:17.602108 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-e304f1b3-3b74-480a-85dc-bdd1086db70e admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:17.603220 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-e304f1b3-3b74-480a-85dc-bdd1086db70e admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Jun 27 15:19:17.603824 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:17 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:17.667077 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-7365fe94-b4bd-40ea-b72d-c313eff3c341 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "vcpus": 1, "ram": 1024, "disk": 10, "rxtx_factor": 1.0, "swap": 0, "name": "ds1G", "os-flavor-access:is_public": true}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:17.688225 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-7365fe94-b4bd-40ea-b72d-c313eff3c341 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077962 Jun 27 15:19:17.689147 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jun 27 15:19:17 2022] POST /compute/v2.1/flavors => generated 404 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:19:17.702266 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-aeef70bc-bb54-4544-880a-0448a03189d5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:17.730079 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-aeef70bc-bb54-4544-880a-0448a03189d5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032070 Jun 27 15:19:17.731742 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jun 27 15:19:17 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:19:19.848126 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-7365fe94-b4bd-40ea-b72d-c313eff3c341 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:19.849277 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-7365fe94-b4bd-40ea-b72d-c313eff3c341 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001585 Jun 27 15:19:19.849627 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:19.929511 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-8a73940f-8ab9-4d27-93b3-92e4255b8d06 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 2048, "disk": 10, "os-flavor-access:is_public": true, "id": "d3", "rxtx_factor": 1.0, "name": "ds2G"}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:19.954189 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-8a73940f-8ab9-4d27-93b3-92e4255b8d06 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.098605 Jun 27 15:19:19.957042 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jun 27 15:19:19 2022] POST /compute/v2.1/flavors => generated 404 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:19:19.976452 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-b290e8e3-eb99-4f1f-bee0-e2380fb5bb3d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:20.003808 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-b290e8e3-eb99-4f1f-bee0-e2380fb5bb3d admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034685 Jun 27 15:19:20.004702 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jun 27 15:19:19 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:19:22.131538 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-8a73940f-8ab9-4d27-93b3-92e4255b8d06 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:22.132576 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-8a73940f-8ab9-4d27-93b3-92e4255b8d06 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 27 15:19:22.132976 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:22.196212 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-f27ec531-1928-4506-a6e4-02945fe44c37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "disk": 20, "name": "ds4G", "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "ram": 4096, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:22.216477 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-f27ec531-1928-4506-a6e4-02945fe44c37 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.076896 Jun 27 15:19:22.224162 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jun 27 15:19:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:19:22.229927 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-35514ec2-18c4-402c-aa27-19bcef3373d4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:22.257027 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-35514ec2-18c4-402c-aa27-19bcef3373d4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030838 Jun 27 15:19:22.258282 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1335 bytes} [Mon Jun 27 15:19:22 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:19:24.382303 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-f27ec531-1928-4506-a6e4-02945fe44c37 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:24.383286 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-f27ec531-1928-4506-a6e4-02945fe44c37 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jun 27 15:19:24.383689 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:24.453688 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-f3c3d396-82e1-4eb0-9756-55af1b9d5082 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:24.479200 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-f3c3d396-82e1-4eb0-9756-55af1b9d5082 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.088580 Jun 27 15:19:24.479953 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jun 27 15:19:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:19:26.603989 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-f27ec531-1928-4506-a6e4-02945fe44c37 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:26.605358 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-f27ec531-1928-4506-a6e4-02945fe44c37 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jun 27 15:19:26.605977 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:26.666460 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-505d405b-9159-41b2-822c-16a40c971107 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "rxtx_factor": 1.0, "disk": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "vcpus": 1}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:26.698778 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-505d405b-9159-41b2-822c-16a40c971107 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.086184 Jun 27 15:19:26.700580 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jun 27 15:19:26 2022] POST /compute/v2.1/flavors => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:19:26.715281 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-6f83fa1e-ecb3-4613-88b2-36dfcf9a68b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:26.750653 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-6f83fa1e-ecb3-4613-88b2-36dfcf9a68b5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041830 Jun 27 15:19:26.765570 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jun 27 15:19:26 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:19:29.221198 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-505d405b-9159-41b2-822c-16a40c971107 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:29.222305 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-505d405b-9159-41b2-822c-16a40c971107 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001669 Jun 27 15:19:29.222716 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:29.293849 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-05b64515-5310-488f-ae70-42cc92c764d8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "disk": 20, "vcpus": 1, "name": "m1.small", "id": "2", "swap": 0, "rxtx_factor": 1.0}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:29.319753 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-05b64515-5310-488f-ae70-42cc92c764d8 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.090077 Jun 27 15:19:29.322651 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jun 27 15:19:29 2022] POST /compute/v2.1/flavors => generated 405 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:19:29.338254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-99db374e-9789-4fe2-89fb-a39059a05742 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:29.369762 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-99db374e-9789-4fe2-89fb-a39059a05742 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036722 Jun 27 15:19:29.370965 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jun 27 15:19:29 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:19:32.184673 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-05b64515-5310-488f-ae70-42cc92c764d8 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:32.185957 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-05b64515-5310-488f-ae70-42cc92c764d8 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001940 Jun 27 15:19:32.186508 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:32 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:32.263794 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-a651dc0c-0cf9-4bd8-bcc4-a10c5e529f9a admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:32.288151 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-a651dc0c-0cf9-4bd8-bcc4-a10c5e529f9a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.093246 Jun 27 15:19:32.289125 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jun 27 15:19:32 2022] POST /compute/v2.1/flavors => generated 406 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:19:32.303576 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-65191e6e-b2e3-42c9-a25c-32fe4a295ade admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:32.333969 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-65191e6e-b2e3-42c9-a25c-32fe4a295ade admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035020 Jun 27 15:19:32.334733 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jun 27 15:19:32 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:19:34.603396 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-a651dc0c-0cf9-4bd8-bcc4-a10c5e529f9a admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:34.604474 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-a651dc0c-0cf9-4bd8-bcc4-a10c5e529f9a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Jun 27 15:19:34.604967 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:34.669325 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-b0402c36-785d-4425-8b79-77d7e943aaa0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "ram": 8192, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 4, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:34.690319 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-b0402c36-785d-4425-8b79-77d7e943aaa0 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.078843 Jun 27 15:19:34.691360 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jun 27 15:19:34 2022] POST /compute/v2.1/flavors => generated 405 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:19:34.703907 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-ef9b6aea-6abf-4330-a370-7f173f1af401 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:34.728886 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-ef9b6aea-6abf-4330-a370-7f173f1af401 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028710 Jun 27 15:19:34.729607 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jun 27 15:19:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:19:36.849090 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-b0402c36-785d-4425-8b79-77d7e943aaa0 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:19:36.850119 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-b0402c36-785d-4425-8b79-77d7e943aaa0 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Jun 27 15:19:36.850510 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:19:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:19:36.912579 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-abf77e5e-b59e-4861-bdae-cb67c115c16a admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8, "id": "5", "name": "m1.xlarge", "disk": 160, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:36.932928 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-abf77e5e-b59e-4861-bdae-cb67c115c16a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075879 Jun 27 15:19:36.933795 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1282 bytes} [Mon Jun 27 15:19:36 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:19:36.946298 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-72f9d700-af91-4d4f-9335-1481c15a604e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:19:36.973237 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-72f9d700-af91-4d4f-9335-1481c15a604e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030558 Jun 27 15:19:36.974499 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1332 bytes} [Mon Jun 27 15:19:36 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:20:01.612188 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-abf77e5e-b59e-4861-bdae-cb67c115c16a admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:01.613254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-abf77e5e-b59e-4861-bdae-cb67c115c16a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001541 Jun 27 15:20:01.613660 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:20:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:20:01.624866 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:20:01.675945 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-baf44358-1798-4b9a-8b35-fcbdea2b1850 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:01.693975 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-baf44358-1798-4b9a-8b35-fcbdea2b1850 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.073818 Jun 27 15:20:01.694504 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jun 27 15:20:01 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:20:02.660500 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-abf77e5e-b59e-4861-bdae-cb67c115c16a admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:02.661483 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-abf77e5e-b59e-4861-bdae-cb67c115c16a admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Jun 27 15:20:02.661881 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:20:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:20:02.865461 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-90f0d1e6-8a4d-4624-b5d6-4957d957f3ab admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:02.871437 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.wsgi [None req-90f0d1e6-8a4d-4624-b5d6-4957d957f3ab admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-90f0d1e6-8a4d-4624-b5d6-4957d957f3ab admin admin] Request method failure captured: Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Accept: application/json Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Accept-Encoding: gzip, deflate Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Connection: keep-alive Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Content-Length: 0 Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Host: 10.222.0.26 Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Openstack-Api-Version: compute 2.90 Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Openstack-System-Scope: None Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: User-Agent: python-novaclient Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Auth-Token: gAAAAABiucqiSF3FEOjJ5rvbCGxYl84aPh1wFhOJqjTebNPWaBaa8znZ-WwIJ1ZsCt7aLRYZtQZeC7lY2HkdSkZk0aTZY_cqwkelS5OVck7cnLiOcEFhIioIJUnd1f9Bc2oVrlICLLoR1H2mOvTc5_eIEUE5r9nMvO_42QbGqw7wQGEDrZ5fTrk Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Domain-Id: None Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Domain-Name: None Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Identity-Status: Confirmed Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Is-Admin-Project: True Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Domain-Id: default Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Domain-Name: Default Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Name: admin Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Role: reader,admin,member Jun 27 15:20:02.874876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Roles: reader,admin,member Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9702a09cdfa2459d8590360a884e14e2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Tenant: admin Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Tenant-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Tenant-Name: admin Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User: admin Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Domain-Id: default Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Domain-Name: Default Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Id: d7a4d53e682240199113e94049a9ab62 Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Name: admin Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: method: > Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: exception: Flavor 42 could not be found. Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: action_args: {'id': '42'} Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:20:02.876524 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:02.877482 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:02.878848 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-90f0d1e6-8a4d-4624-b5d6-4957d957f3ab admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:20:02.880221 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-90f0d1e6-8a4d-4624-b5d6-4957d957f3ab admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.069032 Jun 27 15:20:02.880221 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jun 27 15:20:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:02.886895 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-28ec1c5a-d39e-4b13-8c7c-a7e306e7462b admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:02.890004 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:20:02.910779 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-28ec1c5a-d39e-4b13-8c7c-a7e306e7462b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027911 Jun 27 15:20:02.911272 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jun 27 15:20:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:20:02.922054 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-7cbde356-1372-4cda-b79d-f2b039c7fc3b admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:02.946063 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-7cbde356-1372-4cda-b79d-f2b039c7fc3b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027694 Jun 27 15:20:02.946646 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jun 27 15:20:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:20:02.957069 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-4b42342b-d62a-410c-ac0b-86e634917ffd admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:02.964062 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.wsgi [None req-4b42342b-d62a-410c-ac0b-86e634917ffd admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-4b42342b-d62a-410c-ac0b-86e634917ffd admin admin] Request method failure captured: Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Accept: application/json Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Accept-Encoding: gzip, deflate Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Connection: keep-alive Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Content-Length: 0 Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Host: 10.222.0.26 Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Openstack-Api-Version: compute 2.90 Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Openstack-System-Scope: None Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: User-Agent: python-novaclient Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Auth-Token: gAAAAABiucqiSF3FEOjJ5rvbCGxYl84aPh1wFhOJqjTebNPWaBaa8znZ-WwIJ1ZsCt7aLRYZtQZeC7lY2HkdSkZk0aTZY_cqwkelS5OVck7cnLiOcEFhIioIJUnd1f9Bc2oVrlICLLoR1H2mOvTc5_eIEUE5r9nMvO_42QbGqw7wQGEDrZ5fTrk Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Domain-Id: None Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Domain-Name: None Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Identity-Status: Confirmed Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Is-Admin-Project: True Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Domain-Id: default Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Domain-Name: Default Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Name: admin Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Role: reader,admin,member Jun 27 15:20:02.967480 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Roles: reader,admin,member Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9702a09cdfa2459d8590360a884e14e2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Tenant: admin Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Tenant-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Tenant-Name: admin Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User: admin Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Domain-Id: default Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Domain-Name: Default Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Id: d7a4d53e682240199113e94049a9ab62 Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Name: admin Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: method: > Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: exception: Flavor 42 could not be found. Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: action_args: {'id': '42'} Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:20:02.968961 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:02.969751 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:02.970786 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-4b42342b-d62a-410c-ac0b-86e634917ffd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:20:02.971989 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-4b42342b-d62a-410c-ac0b-86e634917ffd admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015993 Jun 27 15:20:02.971989 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jun 27 15:20:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:03.806096 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-7cbde356-1372-4cda-b79d-f2b039c7fc3b admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:03.807265 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-7cbde356-1372-4cda-b79d-f2b039c7fc3b admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 27 15:20:03.807665 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:20:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:20:03.998789 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-579310d6-5649-4f13-ba44-961021735feb admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:04.005177 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.wsgi [None req-579310d6-5649-4f13-ba44-961021735feb admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-579310d6-5649-4f13-ba44-961021735feb admin admin] Request method failure captured: Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Accept: application/json Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Accept-Encoding: gzip, deflate Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Connection: keep-alive Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Content-Length: 0 Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Host: 10.222.0.26 Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Openstack-Api-Version: compute 2.90 Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Openstack-System-Scope: None Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: User-Agent: python-novaclient Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Auth-Token: gAAAAABiucqjbGTSQje3RzFlReORkj8MwghfMlYjRRZbaDiojsjSWUumopRMg70mzBBcy-Md5z3FoqWy0BSm-GGmF9N7JUF3yfRZK9_f0B-Rdr2cBl5v71WFQ04jRS1KNwkx3B6Z5Mp-HR23LGMaLjRUIB-YGIzeuou3cBa2xJcL9GLXRRYhx4A Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Domain-Id: None Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Domain-Name: None Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Identity-Status: Confirmed Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Is-Admin-Project: True Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Domain-Id: default Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Domain-Name: Default Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Name: admin Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Role: reader,admin,member Jun 27 15:20:04.006769 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Roles: reader,admin,member Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9702a09cdfa2459d8590360a884e14e2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Tenant: admin Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Tenant-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Tenant-Name: admin Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User: admin Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Domain-Id: default Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Domain-Name: Default Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Id: d7a4d53e682240199113e94049a9ab62 Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Name: admin Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: method: > Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: exception: Flavor 84 could not be found. Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: action_args: {'id': '84'} Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:20:04.008254 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:04.009458 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:04.010761 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-579310d6-5649-4f13-ba44-961021735feb admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:20:04.011838 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-579310d6-5649-4f13-ba44-961021735feb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.065392 Jun 27 15:20:04.011838 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jun 27 15:20:03 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:04.018265 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-607e159b-139a-4afa-b24b-2660f9236a33 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:04.032135 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-607e159b-139a-4afa-b24b-2660f9236a33 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017532 Jun 27 15:20:04.032795 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jun 27 15:20:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:20:04.042936 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-01d0e94a-8135-4bc8-942c-b68a19da1483 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:04.057169 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-01d0e94a-8135-4bc8-942c-b68a19da1483 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017978 Jun 27 15:20:04.057720 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jun 27 15:20:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:20:04.068033 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-af328fa3-a3a9-4c91-95a6-ea275ae1cf15 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:04.074192 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.wsgi [None req-af328fa3-a3a9-4c91-95a6-ea275ae1cf15 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-af328fa3-a3a9-4c91-95a6-ea275ae1cf15 admin admin] Request method failure captured: Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Accept: application/json Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Accept-Encoding: gzip, deflate Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Connection: keep-alive Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Content-Length: 0 Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Host: 10.222.0.26 Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Openstack-Api-Version: compute 2.90 Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Openstack-System-Scope: None Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: User-Agent: python-novaclient Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Auth-Token: gAAAAABiucqjbGTSQje3RzFlReORkj8MwghfMlYjRRZbaDiojsjSWUumopRMg70mzBBcy-Md5z3FoqWy0BSm-GGmF9N7JUF3yfRZK9_f0B-Rdr2cBl5v71WFQ04jRS1KNwkx3B6Z5Mp-HR23LGMaLjRUIB-YGIzeuou3cBa2xJcL9GLXRRYhx4A Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Domain-Id: None Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Domain-Name: None Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Identity-Status: Confirmed Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Is-Admin-Project: True Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Domain-Id: default Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Domain-Name: Default Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Name: admin Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Role: reader,admin,member Jun 27 15:20:04.075845 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Roles: reader,admin,member Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9702a09cdfa2459d8590360a884e14e2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Tenant: admin Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Tenant-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Tenant-Name: admin Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User: admin Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Domain-Id: default Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Domain-Name: Default Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Id: d7a4d53e682240199113e94049a9ab62 Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Name: admin Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: method: > Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: exception: Flavor 84 could not be found. Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: action_args: {'id': '84'} Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:20:04.077342 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:04.078263 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:04.079418 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-af328fa3-a3a9-4c91-95a6-ea275ae1cf15 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:20:04.080443 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-af328fa3-a3a9-4c91-95a6-ea275ae1cf15 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013428 Jun 27 15:20:04.080443 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Mon Jun 27 15:20:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:04.909160 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-01d0e94a-8135-4bc8-942c-b68a19da1483 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:04.910287 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-01d0e94a-8135-4bc8-942c-b68a19da1483 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001642 Jun 27 15:20:04.910836 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:20:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:20:05.104859 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-ddf1cec5-1363-45de-a66d-dacb67d3c50b admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:05.110856 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.wsgi [None req-ddf1cec5-1363-45de-a66d-dacb67d3c50b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-ddf1cec5-1363-45de-a66d-dacb67d3c50b admin admin] Request method failure captured: Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Accept: application/json Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Accept-Encoding: gzip, deflate Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Connection: keep-alive Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Content-Length: 0 Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Host: 10.222.0.26 Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Openstack-Api-Version: compute 2.90 Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Openstack-System-Scope: None Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: User-Agent: python-novaclient Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Auth-Token: gAAAAABiucqkf0DvIqQByfxDnuap1yGLmvEewl--W224Lj4N9vF263RJbwwJxs6-mSqq9xsihYREgGdg6jYokOSAWCaMUFniYkyWF7PLBQEtumfrf-4xDhoADvukhsZzDdo6YL1SxVz7SIJ59ZKHXhSQfoohLo6uVy1ho0NHRqsgYMThRhaozLg Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Domain-Id: None Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Domain-Name: None Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Identity-Status: Confirmed Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Is-Admin-Project: True Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Domain-Id: default Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Domain-Name: Default Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Project-Name: admin Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Role: reader,admin,member Jun 27 15:20:05.112363 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Roles: reader,admin,member Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9702a09cdfa2459d8590360a884e14e2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Tenant: admin Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Tenant-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-Tenant-Name: admin Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User: admin Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Domain-Id: default Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Domain-Name: Default Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Id: d7a4d53e682240199113e94049a9ab62 Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: X-User-Name: admin Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: method: > Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: exception: Flavor 451 could not be found. Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: action_args: {'id': '451'} Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:20:05.113823 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:05.114674 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: ERROR nova.api.openstack.wsgi Jun 27 15:20:05.115773 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-ddf1cec5-1363-45de-a66d-dacb67d3c50b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103282) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:20:05.117423 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-ddf1cec5-1363-45de-a66d-dacb67d3c50b admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.066202 Jun 27 15:20:05.117423 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jun 27 15:20:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:05.123842 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-80671af6-ab2d-41ee-b86a-d772e57617ee admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:05.138399 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-80671af6-ab2d-41ee-b86a-d772e57617ee admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018113 Jun 27 15:20:05.138952 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jun 27 15:20:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:20:05.149223 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:05.164053 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018495 Jun 27 15:20:05.164644 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Mon Jun 27 15:20:05 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:20:05.175132 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-8cbe72d7-785c-4f52-ab2f-09c26d136729 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:05.181112 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.wsgi [None req-8cbe72d7-785c-4f52-ab2f-09c26d136729 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-8cbe72d7-785c-4f52-ab2f-09c26d136729 admin admin] Request method failure captured: Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Accept: application/json Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Accept-Encoding: gzip, deflate Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Connection: keep-alive Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Content-Length: 0 Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Host: 10.222.0.26 Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Openstack-Api-Version: compute 2.90 Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Openstack-System-Scope: None Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: User-Agent: python-novaclient Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Auth-Token: gAAAAABiucqkf0DvIqQByfxDnuap1yGLmvEewl--W224Lj4N9vF263RJbwwJxs6-mSqq9xsihYREgGdg6jYokOSAWCaMUFniYkyWF7PLBQEtumfrf-4xDhoADvukhsZzDdo6YL1SxVz7SIJ59ZKHXhSQfoohLo6uVy1ho0NHRqsgYMThRhaozLg Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Domain-Id: None Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Domain-Name: None Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Identity-Status: Confirmed Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Is-Admin-Project: True Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Domain-Id: default Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Domain-Name: Default Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Project-Name: admin Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Role: reader,admin,member Jun 27 15:20:05.182693 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Roles: reader,admin,member Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9702a09cdfa2459d8590360a884e14e2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9702a09cdfa2459d8590360a884e14e2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Tenant: admin Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Tenant-Id: 9702a09cdfa2459d8590360a884e14e2 Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-Tenant-Name: admin Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User: admin Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Domain-Id: default Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Domain-Name: Default Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Id: d7a4d53e682240199113e94049a9ab62 Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: X-User-Name: admin Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: method: > Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: exception: Flavor 451 could not be found. Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: action_args: {'id': '451'} Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:20:05.184380 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:05.185393 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: ERROR nova.api.openstack.wsgi Jun 27 15:20:05.186670 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-8cbe72d7-785c-4f52-ab2f-09c26d136729 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103281) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:20:05.187933 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-8cbe72d7-785c-4f52-ab2f-09c26d136729 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012597 Jun 27 15:20:05.187933 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jun 27 15:20:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 15:20:06.035947 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:06.037015 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Jun 27 15:20:06.037394 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:20:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:20:06.230892 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-69749e28-91b5-4fde-bafd-7436a6e205c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:20:06.251921 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-69749e28-91b5-4fde-bafd-7436a6e205c4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.075959 Jun 27 15:20:06.252740 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jun 27 15:20:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:20:07.118179 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:07.119133 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jun 27 15:20:07.119564 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:20:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:20:07.314075 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-9a17d57c-7d0e-4e09-9394-1adcdc9a456e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:20:07.333402 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-9a17d57c-7d0e-4e09-9394-1adcdc9a456e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.075896 Jun 27 15:20:07.333953 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jun 27 15:20:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:20:08.214980 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:08.215994 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jun 27 15:20:08.216414 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:20:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:20:08.410258 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-3bf8751b-7fd8-4d19-8493-1d317bd2af07 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:20:08.428904 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-3bf8751b-7fd8-4d19-8493-1d317bd2af07 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.074132 Jun 27 15:20:08.429390 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jun 27 15:20:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:20:09.254574 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:09.255603 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Jun 27 15:20:09.256009 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:20:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:20:09.450108 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-a59a77c1-573c-41da-b5e7-8ff513e57216 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:20:09.469913 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-a59a77c1-573c-41da-b5e7-8ff513e57216 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.076917 Jun 27 15:20:09.470363 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Mon Jun 27 15:20:09 2022] POST /compute/v2.1/flavors => generated 409 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:20:10.317511 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:10.318523 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jun 27 15:20:10.318910 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:20:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:20:10.511269 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-efd8ca37-3554-480a-9b33-06635cd89075 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:10.530721 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-efd8ca37-3554-480a-9b33-06635cd89075 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.075535 Jun 27 15:20:10.531201 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Mon Jun 27 15:20:10 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:20:57.804098 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:57.805158 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-678ae811-2c7a-4365-9aec-24ac43f99dae admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jun 27 15:20:57.805567 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 930 bytes} [Mon Jun 27 15:20:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:20:57.816789 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:20:57.870743 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-091e17c8-3201-4c00-bb6d-27522225c589 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:57.890567 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-091e17c8-3201-4c00-bb6d-27522225c589 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.078687 Jun 27 15:20:57.891132 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1291 bytes} [Mon Jun 27 15:20:57 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:20:57.914583 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-9ff7513b-8d39-488f-9de0-cf9c2ba49f7f admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:57.918385 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG dbcounter [-] [103282] Writing DB stats nova_api:SELECT=14 {{(pid=103282) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:20:57.924049 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-9ff7513b-8d39-488f-9de0-cf9c2ba49f7f admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013179 Jun 27 15:20:57.924626 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1282 bytes} [Mon Jun 27 15:20:57 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:20:57.936828 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-1f010ea6-e786-44dc-845b-b25653edaa89 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:57.945159 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-1f010ea6-e786-44dc-845b-b25653edaa89 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011990 Jun 27 15:20:57.945682 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1285 bytes} [Mon Jun 27 15:20:57 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:20:57.957841 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8c7f4d5a-f562-45ee-b579-f74cd8ce5835 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:57.965876 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8c7f4d5a-f562-45ee-b579-f74cd8ce5835 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012016 Jun 27 15:20:57.966444 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1285 bytes} [Mon Jun 27 15:20:57 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:20:57.979775 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-18ff53bb-36f6-4278-b878-be7daa00e97a admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:20:57.987896 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-18ff53bb-36f6-4278-b878-be7daa00e97a admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012940 Jun 27 15:20:57.988356 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1282 bytes} [Mon Jun 27 15:20:57 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:24:12.783915 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8c7f4d5a-f562-45ee-b579-f74cd8ce5835 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:24:12.784975 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8c7f4d5a-f562-45ee-b579-f74cd8ce5835 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001560 Jun 27 15:24:12.785362 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:24:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:24:12.930895 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writing DB stats nova_api:SELECT=6 {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:24:13.058874 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-f2a8099f-9f36-49c0-8b1e-d0b587498d71 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:24:13.060041 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:24:13.060041 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: warnings.warn(msg) Jun 27 15:24:13.061651 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-f2a8099f-9f36-49c0-8b1e-d0b587498d71 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:24:13.062083 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-f2a8099f-9f36-49c0-8b1e-d0b587498d71 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:24:13.063434 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-f2a8099f-9f36-49c0-8b1e-d0b587498d71 admin admin] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:24:13.063434 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-f2a8099f-9f36-49c0-8b1e-d0b587498d71 admin admin] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:24:13.099942 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-f2a8099f-9f36-49c0-8b1e-d0b587498d71 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.170500 Jun 27 15:24:13.100542 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jun 27 15:24:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:24:13.959523 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8c7f4d5a-f562-45ee-b579-f74cd8ce5835 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:24:13.960838 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8c7f4d5a-f562-45ee-b579-f74cd8ce5835 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001834 Jun 27 15:24:13.961340 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:24:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:24:14.167239 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-8a48509b-5992-426d-bb19-6f8ea467177b admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:24:14.168856 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:24:14.168856 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: warnings.warn(msg) Jun 27 15:24:14.170738 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-8a48509b-5992-426d-bb19-6f8ea467177b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:24:14.171426 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-8a48509b-5992-426d-bb19-6f8ea467177b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:24:14.172605 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-8a48509b-5992-426d-bb19-6f8ea467177b admin admin] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:24:14.173220 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-8a48509b-5992-426d-bb19-6f8ea467177b admin admin] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:24:14.196115 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-8a48509b-5992-426d-bb19-6f8ea467177b admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.091206 Jun 27 15:24:14.196798 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jun 27 15:24:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:24:25.487551 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8c7f4d5a-f562-45ee-b579-f74cd8ce5835 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:24:25.488603 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8c7f4d5a-f562-45ee-b579-f74cd8ce5835 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 27 15:24:25.489009 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:24:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:24:25.638568 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writing DB stats nova_cell0:SELECT=4 {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:24:25.639713 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writing DB stats nova_cell1:SELECT=4 {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:24:25.640156 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG dbcounter [-] [103281] Writing DB stats nova_api:SELECT=8 {{(pid=103281) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:24:25.693084 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-321aa51a-fc19-49b5-a8ca-58e5676171d7 admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:24:25.694168 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:24:25.694168 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: warnings.warn(msg) Jun 27 15:24:25.695343 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-321aa51a-fc19-49b5-a8ca-58e5676171d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:24:25.695770 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-321aa51a-fc19-49b5-a8ca-58e5676171d7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:24:25.696585 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-321aa51a-fc19-49b5-a8ca-58e5676171d7 admin admin] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:24:25.697002 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-321aa51a-fc19-49b5-a8ca-58e5676171d7 admin admin] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:24:25.722327 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-321aa51a-fc19-49b5-a8ca-58e5676171d7 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.091074 Jun 27 15:24:25.722898 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jun 27 15:24:25 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:24:26.559395 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: DEBUG nova.api.openstack.wsgi [None req-8c7f4d5a-f562-45ee-b579-f74cd8ce5835 admin admin] Calling method '>' {{(pid=103282) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:24:26.560752 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: INFO nova.api.openstack.requestlog [None req-8c7f4d5a-f562-45ee-b579-f74cd8ce5835 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001974 Jun 27 15:24:26.561568 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: [pid: 103282|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Mon Jun 27 15:24:26 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:24:26.754935 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG nova.api.openstack.wsgi [None req-e98d3141-c220-44c6-b7d7-3abb8621eb8e admin admin] Calling method '>' {{(pid=103281) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:24:26.756167 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 15:24:26.756167 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: warnings.warn(msg) Jun 27 15:24:26.757341 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-e98d3141-c220-44c6-b7d7-3abb8621eb8e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:24:26.757766 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-e98d3141-c220-44c6-b7d7-3abb8621eb8e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:24:26.758539 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-e98d3141-c220-44c6-b7d7-3abb8621eb8e admin admin] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:24:26.758962 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: DEBUG oslo_concurrency.lockutils [None req-e98d3141-c220-44c6-b7d7-3abb8621eb8e admin admin] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103281) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:24:26.781007 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: INFO nova.api.openstack.requestlog [None req-e98d3141-c220-44c6-b7d7-3abb8621eb8e admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.079933 Jun 27 15:24:26.781558 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: [pid: 103281|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Mon Jun 27 15:24:26 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:25:23.917220 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: Mon Jun 27 15:25:23 2022 - graceful shutdown triggered... Jun 27 15:25:23.917775 dv-cinder-847798-1-iscsi devstack@n-api.service[103282]: Gracefully killing worker 2 (pid: 103282)... Jun 27 15:25:23.918266 dv-cinder-847798-1-iscsi devstack@n-api.service[103281]: Gracefully killing worker 1 (pid: 103281)... Jun 27 15:25:23.919368 dv-cinder-847798-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 27 15:25:24.918028 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: worker 1 buried after 1 seconds Jun 27 15:25:24.918028 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: worker 2 buried after 1 seconds Jun 27 15:25:24.918028 dv-cinder-847798-1-iscsi devstack@n-api.service[103257]: goodbye to uWSGI. Jun 27 15:25:24.919664 dv-cinder-847798-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 27 15:25:24.920227 dv-cinder-847798-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 27 15:25:24.923121 dv-cinder-847798-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 15:25:24.932911 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 15:25:24 2022] *** Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: nodename: dv-cinder-847798-1-iscsi Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: machine: x86_64 Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: clock source: unix Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: pcre jit disabled Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: detected number of CPU cores: 4 Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: current working directory: / Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: detected binary path: /usr/bin/uwsgi-core Jun 27 15:25:24.934951 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: your processes number limit is 47680 Jun 27 15:25:24.936009 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: your memory page size is 4096 bytes Jun 27 15:25:24.936009 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: detected max file descriptor number: 2048 Jun 27 15:25:24.936009 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: lock engine: pthread robust mutexes Jun 27 15:25:24.936009 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: thunder lock: enabled Jun 27 15:25:24.936009 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 15:25:24.936009 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 15:25:24.980877 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: Python main interpreter initialized at 0x56266ef8f9c0 Jun 27 15:25:24.980877 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: python threads support enabled Jun 27 15:25:24.980877 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: your server socket listen backlog is limited to 100 connections Jun 27 15:25:24.980877 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: your mercy for graceful operations on workers is 90 seconds Jun 27 15:25:24.981353 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 15:25:24.981353 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: *** Operational MODE: preforking *** Jun 27 15:25:24.981639 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: *** uWSGI is running in multiple interpreter mode *** Jun 27 15:25:24.981639 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: spawned uWSGI master process (pid: 117958) Jun 27 15:25:24.981837 dv-cinder-847798-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 15:25:24.985897 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: spawned uWSGI worker 1 (pid: 117977, cores: 1) Jun 27 15:25:24.985897 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: spawned uWSGI worker 2 (pid: 117978, cores: 1) Jun 27 15:25:24.985897 dv-cinder-847798-1-iscsi devstack@n-api.service[117958]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 15:25:25.654970 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 15:25:25.657930 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 15:25:26.891763 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:25:26.891763 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: from cryptography.utils import int_from_bytes Jun 27 15:25:26.892739 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:25:26.892739 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: from cryptography.utils import int_from_bytes Jun 27 15:25:26.895843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:25:26.895843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: from cryptography.utils import int_from_bytes Jun 27 15:25:26.896490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 15:25:26.896490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: from cryptography.utils import int_from_bytes Jun 27 15:25:29.392257 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 15:25:29.392925 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 15:25:29.393045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 15:25:29.393381 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 15:25:29.393632 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 15:25:29.394345 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.395103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.395396 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.395745 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.396045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.396372 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.396700 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.397044 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.397338 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.397596 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.397910 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.398229 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847798-1-iscsi {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.398549 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.398855 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.399161 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.399474 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.399775 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.400093 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.400416 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.400883 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 15:25:29.401329 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.401436 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 15:25:29.401681 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 15:25:29.402044 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 15:25:29.402331 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 15:25:29.402699 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.402850 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.403072 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.403193 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.403367 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.403477 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.403655 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.403764 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.403969 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.404095 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.404266 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.404488 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.404652 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.404776 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.404945 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.405041 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.405240 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.405359 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.405528 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.405637 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.405843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.405958 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847798-1-iscsi {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.406139 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847798-1-iscsi {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.406242 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.406569 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.406779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.407011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.407211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.407464 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.409530 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.409819 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.410035 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.410337 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.410597 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.410811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.410998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.411179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.411356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.411509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.411675 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.411854 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.412023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.412023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.412341 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.412341 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.412703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.412860 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.413018 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.413167 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.413322 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.413462 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.413601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.413762 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.413909 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.414050 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.414196 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.414353 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.414512 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.414665 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.414811 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.414959 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847798-1-iscsi {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.415117 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.415275 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.415427 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.415567 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.415705 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.415843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.416010 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.416159 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.416351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.416351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.416648 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.416795 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.416947 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.417095 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.417251 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.417390 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.419188 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.419351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.419502 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.419656 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.419818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.419966 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.420122 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.420269 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.420481 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.420635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.420782 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.420921 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.421059 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.421206 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.421357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.421504 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.421654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.421793 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.421939 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.422088 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.422237 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.422386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.422534 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.422675 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.422829 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.423371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.423544 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.423544 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.423832 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.423832 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.424137 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.424293 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.424511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.424511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.424790 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.424949 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.425102 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.425338 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.426331 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.426496 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.426662 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.426805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.426960 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.427109 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.427248 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.427396 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.427551 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.427692 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.428116 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.428295 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.428738 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.428943 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.429111 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.429282 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.429610 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.429758 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.429906 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.430054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.430200 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.430350 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.430509 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.430656 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.430797 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.430935 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.431080 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.431080 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.431366 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.431504 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.431654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.431802 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.431941 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.432095 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.432241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.432577 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.432742 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.432893 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.433041 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.433194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.433849 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.434003 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.434153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.434293 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.434438 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.434590 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.434730 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.434869 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.435035 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.436080 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.436251 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.436429 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.436573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.436724 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.436863 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.437017 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.437174 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.437321 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.437468 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.437616 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.437763 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.437938 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.438326 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.438473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.438964 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.439122 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.439283 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.439424 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.439791 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.439949 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.440097 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.440252 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.440415 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.440622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.440780 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.440780 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.441163 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.441315 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.441461 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.441616 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.441754 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.441899 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.442122 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.442274 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.442413 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.442551 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.442695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.442843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.442994 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.443141 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.443280 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.443427 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.443587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.443735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.443888 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.444027 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.444173 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.444336 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.444482 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.444632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.444785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.444932 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.445077 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.445228 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.445366 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.445522 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.445667 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.445806 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.445951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.446098 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.446237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.446382 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.446531 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.446669 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.446821 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.446967 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.447106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.447243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.447396 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.447537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.447684 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.447837 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.447975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.448122 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.448538 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.448688 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.449190 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.449337 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.449337 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.449618 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.449618 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.450703 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.450857 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.450998 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.451144 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.451284 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.451430 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.451578 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.451727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.451883 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.451883 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.452155 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.452304 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.452496 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.452637 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.452786 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.452925 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.453070 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.453209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.453362 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.453509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.453658 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.453806 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.453945 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.454092 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.454252 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.454411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 15:25:29.454565 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.454565 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.454837 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.454985 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.455143 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.455290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.455434 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.455588 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.455726 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.455873 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.456013 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.456171 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.456373 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.456529 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.456676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.456822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.456972 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.457120 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.457266 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.457412 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.457562 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.457710 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.457858 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.457997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.458153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.458300 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.458706 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.458868 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.459996 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.460158 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.460312 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.460725 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.460909 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.461065 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.461208 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.461359 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.461512 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.461660 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.461800 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.461939 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.462077 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.462303 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.462454 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.462605 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.462754 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.462904 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.463045 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.463203 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.463353 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.463500 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.463639 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.463786 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.463933 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.464086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.464233 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.464466 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.464611 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.464761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.464901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.465091 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.465250 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.465399 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.465559 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.465700 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.468127 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.468435 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.468909 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.469075 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.469639 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.469792 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.469946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.469946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.469946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.469946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.470492 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.470667 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.471057 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.471213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.471354 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.471509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.471649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.471796 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.471995 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.472145 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.472286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.472486 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.472643 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.472804 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.473030 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.473186 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.473569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.473719 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.473867 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.474018 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.474169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.474316 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.474455 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.474594 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.474898 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.475071 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.475213 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.475351 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.475490 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.475629 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.475758 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.475861 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.475957 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476053 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476226 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476329 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476425 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476619 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476711 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476796 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476888 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.476973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477060 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477151 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477233 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477315 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477409 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477492 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477574 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477661 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477751 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.477929 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.478021 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.478111 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.478195 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.478283 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.478367 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.478462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.478545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.478635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.478734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.479035 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.479139 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.479224 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.479333 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.479419 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.479724 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.479829 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.479923 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480009 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480104 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480188 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480277 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480400 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480505 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480591 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480673 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480756 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480837 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.480938 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481046 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481131 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481294 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481375 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481465 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481555 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481636 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481717 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481797 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481878 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.481966 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.482056 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.482152 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.482235 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.482235 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.483129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.483246 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.483246 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.483416 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.483500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.483588 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.483678 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.483769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.483861 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.483951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484041 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484229 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484336 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484435 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484525 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484609 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484698 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484790 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484880 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.484970 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485052 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485134 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485214 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485309 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485400 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485662 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485743 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485832 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.485921 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486185 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486274 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486359 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486440 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486521 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486603 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486683 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486772 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486863 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.486945 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.487026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.487106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.487233 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.487337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.487446 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.487519 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.487595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.487729 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.487829 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.487921 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488093 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488175 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488271 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488508 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488592 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488681 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488764 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488851 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.488957 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.489182 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.489283 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.489375 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.489467 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.489550 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.489652 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.489728 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.489962 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490047 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490137 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490226 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490322 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490406 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490493 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490575 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490663 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490753 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490849 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.490939 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491031 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491122 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491212 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491303 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491382 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491471 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491555 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491644 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491726 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491906 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.491994 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.492083 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.492166 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.492254 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.492254 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.492545 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.492638 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.492731 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.492814 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.492901 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.492991 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493081 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493178 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493359 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493455 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493544 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493630 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493707 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493790 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493867 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.493956 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494038 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494127 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494208 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494288 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494456 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494797 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494883 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.494974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495057 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495137 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495218 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495305 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495386 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495478 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495567 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495648 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495823 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495918 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.495999 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.496087 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.496181 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.496273 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.496568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.496721 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.496814 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.496917 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497000 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497081 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497170 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497257 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497329 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497397 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497464 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497532 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497690 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497836 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497906 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.497975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.498056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.498126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.498126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.498395 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.498783 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.498871 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.499045 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.499289 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.499381 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.499453 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.499651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.499741 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.500060 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.500160 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.500267 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.500417 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.500605 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.500696 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.500916 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.500995 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.501225 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.501302 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.501680 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.502028 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.502310 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.502623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.502876 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.502985 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.503299 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.503473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.503614 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.503938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.504248 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.504381 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.504878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.505228 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.505526 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.505629 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.505856 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.505977 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.506179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.506286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.506502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.506605 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.506834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.506934 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.507160 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.507414 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.507505 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.507760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.507867 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.508086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.508183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.508414 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.508521 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.508722 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.508814 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.509031 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.509120 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.509341 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.509440 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.509637 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.509735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.509990 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.510231 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.510344 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.510440 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.510574 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.510664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.510876 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.510973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.511181 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.511272 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.511487 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.511601 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.511847 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.511997 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.512084 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.512174 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.512420 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.512525 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.512730 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.512829 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.513040 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.513130 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.513350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.513454 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.513652 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.513756 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.513951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.514039 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.514256 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.514346 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.514559 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.514662 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.514873 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.514964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.515180 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.515276 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.515504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.515602 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.515816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.515913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.516122 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.516213 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.516453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.516561 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.516762 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.516849 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.517068 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.517159 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.517368 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.517449 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.517783 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.517924 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.518104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.518260 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.518416 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.518605 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.518768 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.518937 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.519248 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.519697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.519793 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.520026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.520310 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.520633 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.520937 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.521250 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.521468 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.521574 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.521855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.521974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.522132 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.522286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.522447 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.522553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.522750 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.522852 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.523064 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.523184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.523370 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.523481 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.523669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.523751 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.523975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.524057 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.524274 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.524411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.524759 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.524856 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.524964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.525061 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.525271 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.525364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.525576 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.525668 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.525884 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.525977 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.526191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.526284 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.526492 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.526599 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.526814 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.526915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.527121 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.527221 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.527426 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.527633 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.527744 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.527833 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.528019 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.528119 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.528346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.528461 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.528644 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.528735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.528954 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.529064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.529272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.529375 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.529653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.529764 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.529884 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.529975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.530189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.530295 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.530498 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.530648 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.530785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.530923 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.531091 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.531178 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.531367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.531449 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.531667 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.531865 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.531981 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.532125 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.532277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.532386 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.532561 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.532709 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.532860 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.533004 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.533170 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.533320 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.533465 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.533617 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.533760 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.533916 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.534060 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.534201 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.534442 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.534727 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.535039 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.535329 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.535473 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.535643 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.535778 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.535953 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.536084 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.536264 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.536458 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.536602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.536747 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.536894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.537032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.537211 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.537349 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.537607 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.537758 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.537902 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.538046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.538183 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.538325 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.538472 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.538619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.538765 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.538910 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.539047 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.539183 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.539326 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.539475 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.539611 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.539747 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.539967 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.540117 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.540262 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.540409 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.540515 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.540673 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.540819 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.540954 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.541140 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.541272 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.541465 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.541590 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.541769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.541915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.542071 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.542227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.542376 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.542543 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.542679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.542851 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.542992 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.543159 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.543300 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.543483 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.543609 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.543800 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.543918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.544113 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.544227 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.544483 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.544576 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.544813 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.544915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.545142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.545231 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.545448 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.545536 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.545753 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.545844 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.546059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.546156 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.546366 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.546445 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.546675 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.546761 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.546983 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.547110 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.547286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.547393 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.547589 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.547689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.547897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.547990 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.548198 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.548299 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.548597 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.548692 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.548906 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.549001 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.549220 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.549329 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.549533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.549634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.549848 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.550026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.550212 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.550516 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.550763 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.550877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.551031 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.551134 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.551350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.551462 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.551656 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.551765 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.552011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.552148 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.552412 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.552543 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.552725 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.552836 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.553038 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.553154 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.553342 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.553452 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.553643 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.553763 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.553949 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.554041 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.554267 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.554359 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.554569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.554658 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.554870 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.554978 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.555172 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.555287 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.555491 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.555592 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.555794 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.555883 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.556113 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.556212 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.556511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.556607 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.556816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.556997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.557127 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.557217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.557450 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.557548 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.557759 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.557877 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.558070 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.558171 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.558372 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.558485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.558690 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.558795 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.558998 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.559089 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.559321 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.559413 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.559650 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.559749 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.559963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.560112 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.560701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.561017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.561176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.561333 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.561479 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.561630 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.561784 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.561933 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.562072 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.562253 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.562387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.562610 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.562763 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.562858 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.563032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.563170 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.563318 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.563418 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.563570 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.563707 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.563851 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.563995 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.564130 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.564266 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.564424 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.564606 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.564750 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.564894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.565062 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.565194 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.565339 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.565484 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.565773 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.565912 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.566089 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.566411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.566544 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.566772 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.566903 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.567098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.567232 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.567388 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.567526 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.567704 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.567849 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.568022 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.568155 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.568389 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.568487 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.568701 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.568795 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.569015 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.569115 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.569321 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.569413 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.569629 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.569721 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.569952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.570073 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.570262 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.570422 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.570576 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.570737 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.570883 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.571118 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.571264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.571403 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.571558 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.571697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.571833 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.571981 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.572119 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.572253 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.572415 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.572572 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.572804 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.572955 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.573093 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.573237 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.573388 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.573523 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.573674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.573818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.573962 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.574107 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.574251 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.574397 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.574550 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.574696 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.574832 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.574965 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.575147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.575296 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.575443 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.575586 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.575766 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.575904 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.576082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.576226 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.576404 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.576497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.576701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.576791 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.577013 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.577120 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.577315 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.577414 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.577620 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.577727 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.577924 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.578023 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.578231 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.578337 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.578533 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.578625 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.578833 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.579015 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.579135 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.579224 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.579455 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.579553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.579760 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.579854 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.580078 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.580174 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.580405 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.580499 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.580711 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.580811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.581082 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.581263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.581452 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.581599 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.581696 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.582191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.582305 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.582507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.582634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.582816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.582938 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.583143 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.583244 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.583455 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.583546 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.583763 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.583872 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.584073 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.584164 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.584404 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.584514 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.584733 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.584828 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.585047 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.585147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.585360 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.585453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.585674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.585767 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.585987 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.586078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.586301 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.586400 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.586616 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.586710 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.586928 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.587046 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.587238 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.587329 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.587550 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.587650 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.587862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.587951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.588176 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.588450 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.588547 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.588781 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.588883 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.589095 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.589186 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.589407 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.589512 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.589720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.589817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.590031 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.590129 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.590342 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.590441 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.590655 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.590905 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.590998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.591250 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.591377 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.591554 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.591643 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.591876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.591965 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.592194 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.592291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.592540 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.592634 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.592864 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.592978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.593185 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.593289 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.593496 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.593597 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.593809 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.593897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.594124 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.594213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.594452 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.594540 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.594776 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.594879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.595080 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.595171 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.595393 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.595491 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.595708 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.595801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.596019 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.596111 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.596368 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.596465 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.596656 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.596767 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.597075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.597277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.597377 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.597884 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.598025 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.598210 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.598341 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.598536 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.598661 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.598867 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.598972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.599164 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.599277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.599476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.599569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.599796 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.599898 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.600113 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.600205 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.600459 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.600587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.600776 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.600880 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.601096 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.601199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.601426 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.601635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.601778 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.601937 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.602079 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.602275 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.602410 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.602598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.602698 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.602927 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.603064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.603250 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.603395 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.603567 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.603823 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.603964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.604141 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.604275 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.604498 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.604646 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.604808 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.604950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.605113 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.605247 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.605417 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.605556 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.605734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.605867 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.606023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.606161 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.606332 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.606477 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.606646 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.606788 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.606951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.607090 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.607259 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.607484 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.607632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.607841 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.607976 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.608158 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.608300 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.608494 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.608592 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.608814 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.608905 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.609125 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.609225 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.609431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.609690 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.609787 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.610043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.610147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.610349 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.610438 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.610668 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.610769 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.610981 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.611093 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.611286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.611407 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.611593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.611702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.611904 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.612009 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.612212 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.612300 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.612616 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.613037 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.613139 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.613381 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.613468 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.613714 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.613819 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.614012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.614133 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.614315 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.614406 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.614624 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.614713 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.614933 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.615039 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.615243 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.615340 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.615547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.615636 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.615856 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.615969 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.616152 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.616243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.616481 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.616574 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.616794 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.616916 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.617103 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.617199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.617413 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.617518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.617720 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.617830 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.618032 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.618156 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.618338 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.618444 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.618656 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.618769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.618964 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.619055 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.619276 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.619373 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.619587 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.619686 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.619908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.620086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.620208 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.620345 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.620536 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.620632 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.620864 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.620969 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.621185 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.621364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.621490 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.621646 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.621816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.621916 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.622113 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.622223 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.622423 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.622659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.622767 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.622994 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.623111 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.623318 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.623423 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.623649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.623762 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.623974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.624085 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.624281 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.624556 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.624666 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.624888 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.624980 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.625214 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.625316 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.625520 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.625612 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.625829 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.625929 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.626136 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.626231 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.626447 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.626540 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.626752 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.626841 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.627056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.627155 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.627365 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.627455 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.627676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.627775 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.628020 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.628119 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.628441 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.628788 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.628944 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.629156 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.629298 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.629434 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.629582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.629729 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.629871 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.630020 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.630165 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.630311 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.630484 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.630630 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.630806 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.630955 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.631121 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.631216 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.631441 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.631577 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.631762 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.631905 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.632074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.632184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.632453 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.632592 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.632739 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.632889 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.633037 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.633182 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.633320 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.633460 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.633636 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.633727 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.633950 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.634090 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.634257 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.634400 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.634585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.634772 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.634935 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.635089 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.635226 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.635406 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.635539 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.635725 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.636032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.636134 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.636368 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.636467 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.636692 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.636798 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.636998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.637087 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.637315 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.637415 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.637711 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.637817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.637949 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.638050 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.638259 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.638462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.638566 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.638659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.638882 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.639078 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.639200 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.639290 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.639503 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.639596 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.639807 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.639908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.640110 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.640201 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.640456 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.640549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.640770 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.640934 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.641087 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.641227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.641391 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.641530 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.641679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.641819 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.641956 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.642081 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.642247 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.642408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.642560 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.642697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.642851 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.642993 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.643138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.643271 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.643412 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.643496 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.643788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.643887 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.644177 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.644518 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.644644 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.644824 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.644939 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.645130 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.645248 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.645440 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.645572 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.645749 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.645858 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.646055 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.646145 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.646361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.646460 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.646670 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.646769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.646975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.647065 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.647282 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.647374 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.647586 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.647677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.647890 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.647988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.648195 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.648289 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.648553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.648652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.648864 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.648966 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.649198 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.649296 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.649489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.649581 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.649799 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.649902 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.650115 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.650203 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.650423 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.650519 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.650726 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.650827 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.651050 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.651139 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.651354 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.651446 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.651662 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.651765 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.651971 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.652063 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.652279 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.652414 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.652605 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.652704 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.652911 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.653002 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.653218 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.653307 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.653530 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.653624 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.653837 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.653927 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.654160 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.654264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.654470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.654567 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.654780 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.654869 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.655090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.655192 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.655398 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.655496 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.655717 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.655823 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.656026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.656158 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.656362 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.656465 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.656664 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.656770 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.656971 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.657074 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.657282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.657419 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.657593 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.657692 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.657902 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.657995 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.658210 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.658384 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.658509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.658598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.658828 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.658981 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.659148 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.659288 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.659507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.659692 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.659840 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.660254 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.660415 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.660691 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.660825 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.661032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.661179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.661335 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.661482 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.661659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.661750 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.661969 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.662116 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.662269 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.662402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.662503 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117977) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 15:25:29.662640 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.662889 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 15:25:29.663132 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117978) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 15:25:29.725624 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO dbcounter [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Registered counter for database nova_api Jun 27 15:25:29.726452 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO dbcounter [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Registered counter for database nova_api Jun 27 15:25:29.746942 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_db.sqlalchemy.engines [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:25:29.748457 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_db.sqlalchemy.engines [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117977) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:25:29.755563 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writer thread running {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:25:29.755754 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writer thread running {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:25:29.813090 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.context [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3576ccde-37ef-449d-b98e-5672f36557b1(cell1) {{(pid=117978) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 15:25:29.813384 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.context [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3576ccde-37ef-449d-b98e-5672f36557b1(cell1) {{(pid=117977) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 15:25:29.817396 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:25:29.818110 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:25:29.819145 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:25:29.819725 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:25:29.819961 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:25:29.820555 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:25:29.821951 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:25:29.822487 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:25:29.823977 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO dbcounter [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Registered counter for database nova_cell0 Jun 27 15:25:29.824541 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO dbcounter [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Registered counter for database nova_cell0 Jun 27 15:25:29.828102 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO dbcounter [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Registered counter for database nova_cell1 Jun 27 15:25:29.828774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO dbcounter [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Registered counter for database nova_cell1 Jun 27 15:25:29.836159 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_db.sqlalchemy.engines [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:25:29.838711 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_db.sqlalchemy.engines [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117977) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:25:29.841612 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_db.sqlalchemy.engines [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117977) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:25:29.841789 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writer thread running {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:25:29.842513 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_db.sqlalchemy.engines [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:25:29.845174 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writer thread running {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:25:29.988787 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writer thread running {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:25:29.992038 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writer thread running {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:25:29.998964 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO dbcounter [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Registered counter for database nova_cell0 Jun 27 15:25:30.001520 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO dbcounter [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Registered counter for database nova_cell0 Jun 27 15:25:30.006945 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_db.sqlalchemy.engines [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117978) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:25:30.008864 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_db.sqlalchemy.engines [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117977) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 15:25:30.012046 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writer thread running {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:25:30.013647 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writer thread running {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 15:25:30.340934 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: WARNING keystonemiddleware.auth_token [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:25:30.348519 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: WARNING keystonemiddleware.auth_token [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:25:30.349630 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: WARNING keystonemiddleware.auth_token [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:25:30.357138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: WARNING keystonemiddleware.auth_token [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:25:30.699623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: WARNING keystonemiddleware.auth_token [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:25:30.705822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: WARNING keystonemiddleware.auth_token [None req-d1eea9cd-fb56-40c3-a9cd-53753e3d5b1b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:25:30.710837 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: WARNING keystonemiddleware.auth_token [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 15:25:30.711515 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56266ef8f9c0 pid: 117978 (default app) Jun 27 15:25:30.717025 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: WARNING keystonemiddleware.auth_token [None req-046bcf68-4661-45a7-a661-fef0a2e31b1f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 15:25:30.722669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56266ef8f9c0 pid: 117977 (default app) Jun 27 15:26:15.408529 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:15.411699 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:15.412999 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:15.414981 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:15.725701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:15.729830 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:15.733110 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:15.735682 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:17.414172 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-03034274-bc2b-4719-b19f-d1d3ebf1a796 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] Action: 'create', calling method: .version_select at 0x7fb279615790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-217576209", "metadata": {"Type": "work"}}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:26:17.759207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a4a967ec-b565-45f6-ad90-d2ce9b2a5a3a tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Action: 'create', calling method: .version_select at 0x7fb279618700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-922150455"}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:26:18.538437 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-03034274-bc2b-4719-b19f-d1d3ebf1a796 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.173558 Jun 27 15:26:18.539416 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 1/1] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jun 27 15:26:15 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3177 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 15:26:18.546509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a8f98af8-8d55-4f4b-a2a5-83bac2b0400d tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb2794df5e0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:18.818087 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a8f98af8-8d55-4f4b-a2a5-83bac2b0400d tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/58166851-bf55-4de6-8d0f-6e550461f5ba" status: 200 len: 351 microversion: 2.1 time: 0.276590 Jun 27 15:26:18.819024 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 2/2] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:18 2022] GET /compute/v2.1/os-volumes/58166851-bf55-4de6-8d0f-6e550461f5ba => generated 351 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:18.826051 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d02f3ebd-9ea9-4b86-bc86-b77012b45fc3 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] Calling method '.version_select at 0x7fb2794df700>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:19.600732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d02f3ebd-9ea9-4b86-bc86-b77012b45fc3 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc" status: 200 len: 353 microversion: 2.1 time: 0.780021 Jun 27 15:26:19.609265 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 3/3] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:18 2022] GET /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc => generated 353 bytes in 789 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:19.615690 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-35fda581-1bde-490c-8ca1-133e1e587a33 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] Calling method '.version_select at 0x7fb2794dfdc0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:19.741720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a4a967ec-b565-45f6-ad90-d2ce9b2a5a3a tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.032983 Jun 27 15:26:19.744589 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 1/4] 10.222.0.26 () {60 vars in 1154 bytes} [Mon Jun 27 15:26:15 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4038 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 15:26:19.760988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-06f84ae1-0962-434f-be1f-3cef798bf12c tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb2794df550>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:19.826093 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-35fda581-1bde-490c-8ca1-133e1e587a33 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc" status: 200 len: 353 microversion: 2.1 time: 0.214772 Jun 27 15:26:19.827067 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 4/5] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:19 2022] GET /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc => generated 353 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:19.850068 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-06f84ae1-0962-434f-be1f-3cef798bf12c tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36" status: 200 len: 344 microversion: 2.1 time: 0.098050 Jun 27 15:26:19.857461 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 2/6] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:19 2022] GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36 => generated 344 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:26:19.874036 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-71d7e6e1-e1a9-4131-b00b-0c33744a7e55 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] Calling method '.version_select at 0x7fb2794784c0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:20.045294 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-71d7e6e1-e1a9-4131-b00b-0c33744a7e55 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc" status: 202 len: 0 microversion: 2.1 time: 0.203631 Jun 27 15:26:20.047182 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 5/7] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jun 27 15:26:19 2022] DELETE /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc => generated 0 bytes in 207 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:26:20.056268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-552379a7-8e00-44ec-9a1b-358cee8bd438 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] Calling method '.version_select at 0x7fb2794df820>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:20.222094 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-552379a7-8e00-44ec-9a1b-358cee8bd438 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc" status: 200 len: 352 microversion: 2.1 time: 0.169075 Jun 27 15:26:20.224775 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 3/8] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:20 2022] GET /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc => generated 352 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:20.824756 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b7a6f998-e48e-4287-be5b-45b62b292f5c tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb2794dfd30>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:20.872462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-188f4a90-db41-4e2b-bbbc-c4a0f47456b3 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb2794dfdc0>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:20.917046 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b7a6f998-e48e-4287-be5b-45b62b292f5c tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/079c9112-67c7-49ff-a6ee-c94e4fe528c1" status: 200 len: 351 microversion: 2.1 time: 0.104956 Jun 27 15:26:20.940293 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 6/9] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:20 2022] GET /compute/v2.1/os-volumes/079c9112-67c7-49ff-a6ee-c94e4fe528c1 => generated 351 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:20.997052 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-188f4a90-db41-4e2b-bbbc-c4a0f47456b3 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36" status: 200 len: 345 microversion: 2.1 time: 0.130296 Jun 27 15:26:21.013026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 4/10] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:20 2022] GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36 => generated 345 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:21.029735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e7f28712-9942-4d8f-899a-22026a2b4bc8 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Action: 'create', calling method: .version_select at 0x7fb2794df8b0>, body: {"snapshot": {"volume_id": "73346829-e48a-4b12-8d99-68db6c32be36", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1858515632"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:26:21.238126 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4d77893e-cf54-478f-ad5c-570973b33193 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] Calling method '.version_select at 0x7fb2794774c0>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:21.857896 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e7f28712-9942-4d8f-899a-22026a2b4bc8 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.839511 Jun 27 15:26:21.879975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 7/11] 10.222.0.26 () {60 vars in 1161 bytes} [Mon Jun 27 15:26:21 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 863 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:21.897120 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cf7f0cb4-ad7a-4df9-8f84-1f37bb8f9ca4 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb279478af0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:21.937453 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-4d77893e-cf54-478f-ad5c-570973b33193 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] HTTP exception thrown: Volume 1ca0feca-254c-4008-aa10-7ac08f85a4dc could not be found. Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4d77893e-cf54-478f-ad5c-570973b33193 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] Request method failure captured: Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc HTTP/1.1 Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwXKjZQwDPj3E-X2kIu6AI_EcAlBXhjFjX3avKNtVT11LGhwkXNTd8XWj1yUd5KLe8GeTOw9BdUbv3IWqHFE8xhQ98Jy4VNYr9wLaQzepnJBND308gwzoW5JXnus1Za0iQZe_rFbQ959uMW6cyEZ-7jfZLEcSF-u0Xv_Hj1NpW7xw4 Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 074c7de8debf489aa5c073a1ae623259 Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesGetTestJSON-184783403 Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:26:21.945059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_074c7de8debf489aa5c073a1ae623259", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/074c7de8debf489aa5c073a1ae623259"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/074c7de8debf489aa5c073a1ae623259"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/074c7de8debf489aa5c073a1ae623259"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesGetTestJSON-184783403 Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 074c7de8debf489aa5c073a1ae623259 Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesGetTestJSON-184783403 Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesGetTestJSON-184783403-project Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: b952197a0c3e417eb6fe206f2954743f Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesGetTestJSON-184783403-project Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Volume 1ca0feca-254c-4008-aa10-7ac08f85a4dc could not be found. Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '1ca0feca-254c-4008-aa10-7ac08f85a4dc'} Jun 27 15:26:21.949361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1ca0feca-254c-4008-aa10-7ac08f85a4dc could not be found. (HTTP 404) (Request-ID: req-a1e1726a-087e-4e9c-a89e-befb1e227cbc) Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:21.951176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:26:21.954968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1ca0feca-254c-4008-aa10-7ac08f85a4dc could not be found. Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:26:21.957582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1ca0feca-254c-4008-aa10-7ac08f85a4dc could not be found. Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1ca0feca-254c-4008-aa10-7ac08f85a4dc could not be found. Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4d77893e-cf54-478f-ad5c-570973b33193 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] Returning 404 to user: Volume 1ca0feca-254c-4008-aa10-7ac08f85a4dc could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4d77893e-cf54-478f-ad5c-570973b33193 tempest-VolumesGetTestJSON-184783403 tempest-VolumesGetTestJSON-184783403-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc" status: 404 len: 109 microversion: 2.1 time: 0.712489 Jun 27 15:26:21.966132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 5/12] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:21 2022] GET /compute/v2.1/os-volumes/1ca0feca-254c-4008-aa10-7ac08f85a4dc => generated 109 bytes in 727 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:26:22.013748 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cf7f0cb4-ad7a-4df9-8f84-1f37bb8f9ca4 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc" status: 200 len: 287 microversion: 2.1 time: 0.130132 Jun 27 15:26:22.014571 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 8/13] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jun 27 15:26:21 2022] GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc => generated 287 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:22.033294 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-14892675-4545-473e-a4df-406941109800 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb279477dc0>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:22.147288 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-14892675-4545-473e-a4df-406941109800 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.121066 Jun 27 15:26:22.149218 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 6/14] 10.222.0.26 () {58 vars in 1139 bytes} [Mon Jun 27 15:26:22 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:22.165320 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d122121d-6b42-4c81-b5f3-e8ccf48435a1 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb2794df820>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:22.254092 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d122121d-6b42-4c81-b5f3-e8ccf48435a1 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc" status: 200 len: 287 microversion: 2.1 time: 0.094403 Jun 27 15:26:22.255447 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 9/15] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jun 27 15:26:22 2022] GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc => generated 287 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:23.283567 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e9350909-873c-4838-9028-40204be45bde tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb279477ee0>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:23.394382 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e9350909-873c-4838-9028-40204be45bde tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc" status: 200 len: 287 microversion: 2.1 time: 0.125874 Jun 27 15:26:23.396023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 7/16] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jun 27 15:26:23 2022] GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc => generated 287 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:24.414417 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3a4936fc-a07a-4bce-94f4-acdcc0a16975 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb2794dff70>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:24.572079 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3a4936fc-a07a-4bce-94f4-acdcc0a16975 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc" status: 200 len: 287 microversion: 2.1 time: 0.166047 Jun 27 15:26:24.579937 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 10/17] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jun 27 15:26:24 2022] GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc => generated 287 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:25.593727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fb23e358-9746-48ed-94e4-7a7d2d38ddb6 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb2794df550>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:25.693715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fb23e358-9746-48ed-94e4-7a7d2d38ddb6 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc" status: 200 len: 288 microversion: 2.1 time: 0.104073 Jun 27 15:26:25.694349 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 8/18] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jun 27 15:26:25 2022] GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc => generated 288 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:25.706104 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ab1ac6d8-a273-4889-8569-da2614be8886 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb279478040>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:25.707036 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-10baa529-8bc9-43a1-bc06-9a3d2aba9cf5 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb27947a5e0>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:25.890977 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ab1ac6d8-a273-4889-8569-da2614be8886 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/eba0299a-2c03-4515-8c67-06698871ead5" status: 200 len: 350 microversion: 2.1 time: 0.193603 Jun 27 15:26:25.893367 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 11/19] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:25 2022] GET /compute/v2.1/os-volumes/eba0299a-2c03-4515-8c67-06698871ead5 => generated 350 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:25.920390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-56b10b0a-4b51-42b1-9521-427fb1356dc3 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb279478670>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:25.931305 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-10baa529-8bc9-43a1-bc06-9a3d2aba9cf5 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc" status: 202 len: 0 microversion: 2.1 time: 0.229769 Jun 27 15:26:25.933018 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 9/20] 10.222.0.26 () {58 vars in 1253 bytes} [Mon Jun 27 15:26:25 2022] DELETE /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:26:25.950617 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fa225ae0-b23f-45d7-a764-dc29e4c4720b tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb279477b80>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:26.043892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fa225ae0-b23f-45d7-a764-dc29e4c4720b tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc" status: 200 len: 287 microversion: 2.1 time: 0.104803 Jun 27 15:26:26.045938 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 10/21] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jun 27 15:26:25 2022] GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc => generated 287 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:26:26.144206 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-56b10b0a-4b51-42b1-9521-427fb1356dc3 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.229227 Jun 27 15:26:26.145734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 12/22] 10.222.0.26 () {58 vars in 1133 bytes} [Mon Jun 27 15:26:25 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:26.165604 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3c26a6d7-0e9c-4057-99e3-e0e6f200fd99 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb2794df550>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:26.307800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3c26a6d7-0e9c-4057-99e3-e0e6f200fd99 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.152187 Jun 27 15:26:26.310974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 11/23] 10.222.0.26 () {58 vars in 1148 bytes} [Mon Jun 27 15:26:26 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:26.327453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5549fb0d-54a4-4665-982f-533ab224a2e3 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb279478f70>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:26.581818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5549fb0d-54a4-4665-982f-533ab224a2e3 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.261691 Jun 27 15:26:26.584602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 13/24] 10.222.0.26 () {58 vars in 1133 bytes} [Mon Jun 27 15:26:26 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:26.615985 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2728e70a-60a2-46e6-b4f3-e554748fb075 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb27947aaf0>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:26.969018 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2728e70a-60a2-46e6-b4f3-e554748fb075 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.374916 Jun 27 15:26:26.970014 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 12/25] 10.222.0.26 () {58 vars in 1166 bytes} [Mon Jun 27 15:26:26 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:26.990414 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6d7a7db2-74ab-471f-9627-95dbbecdf555 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb279478e50>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:27.061464 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-62c81500-c354-451f-8d8f-e87239e88bad tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb27947a0d0>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:27.163731 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-62c81500-c354-451f-8d8f-e87239e88bad tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] HTTP exception thrown: Snapshot a17f3820-64a8-43ba-8414-89e0774c9ddc could not be found. Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-62c81500-c354-451f-8d8f-e87239e88bad tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Request method failure captured: Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc HTTP/1.1 Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwXTFOzyaggYHNTy-qg9yng5G8qxe3N7yeSWIWefZIkEDwjH40YyDd2kdC_BdEMJ93FkMSTu6tyvTMK2DbdT9DzivBtMf0nITvOOcpXpQFnpC4xj4A_7wjwvtfHaB-rEpLqd2xWFaPHGILY_vVab4TQjH3I5NT1EDSWdkjdOPTWlqw Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: e9c75d75a0ea45818f28071163cb93ad Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:26:27.181568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e9c75d75a0ea45818f28071163cb93ad", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: e9c75d75a0ea45818f28071163cb93ad Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesSnapshotsTestJSON-912768496-project Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: d32af5ae84b34f079b84bc416fb5b576 Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesSnapshotsTestJSON-912768496-project Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Snapshot a17f3820-64a8-43ba-8414-89e0774c9ddc could not be found. Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'a17f3820-64a8-43ba-8414-89e0774c9ddc'} Jun 27 15:26:27.183715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot a17f3820-64a8-43ba-8414-89e0774c9ddc could not be found. (HTTP 404) (Request-ID: req-a85002f1-259d-44c3-8c8a-ba11aca8d53a) Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:27.185634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:26:27.187304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot a17f3820-64a8-43ba-8414-89e0774c9ddc could not be found. Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 27 15:26:27.189098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot a17f3820-64a8-43ba-8414-89e0774c9ddc could not be found. Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot a17f3820-64a8-43ba-8414-89e0774c9ddc could not be found. Jun 27 15:26:27.191194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:27.195709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-62c81500-c354-451f-8d8f-e87239e88bad tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Returning 404 to user: Snapshot a17f3820-64a8-43ba-8414-89e0774c9ddc could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:26:27.198078 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-62c81500-c354-451f-8d8f-e87239e88bad tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc" status: 404 len: 111 microversion: 2.1 time: 0.143582 Jun 27 15:26:27.205002 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1250 bytes} [Mon Jun 27 15:26:27 2022] GET /compute/v2.1/os-snapshots/a17f3820-64a8-43ba-8414-89e0774c9ddc => generated 111 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:26:27.215266 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-37f0fb67-fecc-4592-8707-d6b0b0dc14de tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb279542040>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:27.267205 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6d7a7db2-74ab-471f-9627-95dbbecdf555 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.283315 Jun 27 15:26:27.280547 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1169 bytes} [Mon Jun 27 15:26:26 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:27.304049 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d5079907-0f41-46a5-95a4-128715ab901a tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb2794dfaf0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:27.428248 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-37f0fb67-fecc-4592-8707-d6b0b0dc14de tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36" status: 202 len: 0 microversion: 2.1 time: 0.220572 Jun 27 15:26:27.434485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 14/28] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jun 27 15:26:27 2022] DELETE /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36 => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:26:27.459855 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-352e7e05-2939-4cb5-99a0-833dd44fb1b3 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb27947a820>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:27.570220 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-352e7e05-2939-4cb5-99a0-833dd44fb1b3 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36" status: 200 len: 344 microversion: 2.1 time: 0.131769 Jun 27 15:26:27.578489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 15/29] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:27 2022] GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36 => generated 344 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:27.606768 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d5079907-0f41-46a5-95a4-128715ab901a tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.320163 Jun 27 15:26:27.610653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 15/30] 10.222.0.26 () {58 vars in 1154 bytes} [Mon Jun 27 15:26:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:26:27.638644 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3b9a1b4a-677f-4e16-8a74-c7d2355bd61b tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb27947a670>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:27.909862 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3b9a1b4a-677f-4e16-8a74-c7d2355bd61b tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.288955 Jun 27 15:26:27.915871 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 16/31] 10.222.0.26 () {58 vars in 1187 bytes} [Mon Jun 27 15:26:27 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:26:27.951343 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-83bc60c1-7735-44b0-a9e7-76e6398b6522 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] Calling method '.version_select at 0x7fb2794df4c0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:28.194390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-83bc60c1-7735-44b0-a9e7-76e6398b6522 tempest-VolumesTestJSON-2050063424 tempest-VolumesTestJSON-2050063424-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.262510 Jun 27 15:26:28.208828 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 16/32] 10.222.0.26 () {58 vars in 1154 bytes} [Mon Jun 27 15:26:27 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:28.588805 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e799612f-3aa9-438e-a649-bc8e4df3439d tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb279477af0>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:28.650164 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-e799612f-3aa9-438e-a649-bc8e4df3439d tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] HTTP exception thrown: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e799612f-3aa9-438e-a649-bc8e4df3439d tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Request method failure captured: Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36 HTTP/1.1 Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwXTFOzyaggYHNTy-qg9yng5G8qxe3N7yeSWIWefZIkEDwjH40YyDd2kdC_BdEMJ93FkMSTu6tyvTMK2DbdT9DzivBtMf0nITvOOcpXpQFnpC4xj4A_7wjwvtfHaB-rEpLqd2xWFaPHGILY_vVab4TQjH3I5NT1EDSWdkjdOPTWlqw Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: e9c75d75a0ea45818f28071163cb93ad Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:26:28.653997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e9c75d75a0ea45818f28071163cb93ad", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: e9c75d75a0ea45818f28071163cb93ad Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesSnapshotsTestJSON-912768496-project Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: d32af5ae84b34f079b84bc416fb5b576 Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesSnapshotsTestJSON-912768496-project Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '73346829-e48a-4b12-8d99-68db6c32be36'} Jun 27 15:26:28.656268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. (HTTP 404) (Request-ID: req-cb6019d2-0d15-43ed-b085-5a789186e3cd) Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:28.657707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:26:28.659709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:26:28.662975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e799612f-3aa9-438e-a649-bc8e4df3439d tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Returning 404 to user: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e799612f-3aa9-438e-a649-bc8e4df3439d tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36" status: 404 len: 109 microversion: 2.1 time: 0.073574 Jun 27 15:26:28.664769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 17/33] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:28 2022] GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36 => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:26:28.672184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ae0f68ec-961c-48ff-8e47-f5435355e525 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb279478dc0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:28.803372 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-ae0f68ec-961c-48ff-8e47-f5435355e525 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] HTTP exception thrown: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ae0f68ec-961c-48ff-8e47-f5435355e525 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Request method failure captured: Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36 HTTP/1.1 Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwXTFOzyaggYHNTy-qg9yng5G8qxe3N7yeSWIWefZIkEDwjH40YyDd2kdC_BdEMJ93FkMSTu6tyvTMK2DbdT9DzivBtMf0nITvOOcpXpQFnpC4xj4A_7wjwvtfHaB-rEpLqd2xWFaPHGILY_vVab4TQjH3I5NT1EDSWdkjdOPTWlqw Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: e9c75d75a0ea45818f28071163cb93ad Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:26:28.811054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e9c75d75a0ea45818f28071163cb93ad", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: e9c75d75a0ea45818f28071163cb93ad Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesSnapshotsTestJSON-912768496-project Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: d32af5ae84b34f079b84bc416fb5b576 Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesSnapshotsTestJSON-912768496-project Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '73346829-e48a-4b12-8d99-68db6c32be36'} Jun 27 15:26:28.812358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. (HTTP 404) (Request-ID: req-074f68c3-6244-408c-8b9a-7d7c5f08d292) Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:28.813489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:26:28.814702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 15:26:28.815802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.817401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.818537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ae0f68ec-961c-48ff-8e47-f5435355e525 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Returning 404 to user: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:26:28.820376 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ae0f68ec-961c-48ff-8e47-f5435355e525 tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36" status: 404 len: 109 microversion: 2.1 time: 0.152982 Jun 27 15:26:28.820376 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 17/34] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jun 27 15:26:28 2022] DELETE /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36 => generated 109 bytes in 154 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:26:28.830361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-19008896-22fd-4c64-803b-2da6f2a8963b tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Calling method '.version_select at 0x7fb27947aa60>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:28.901060 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-19008896-22fd-4c64-803b-2da6f2a8963b tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] HTTP exception thrown: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-19008896-22fd-4c64-803b-2da6f2a8963b tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Request method failure captured: Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36 HTTP/1.1 Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwXTFOzyaggYHNTy-qg9yng5G8qxe3N7yeSWIWefZIkEDwjH40YyDd2kdC_BdEMJ93FkMSTu6tyvTMK2DbdT9DzivBtMf0nITvOOcpXpQFnpC4xj4A_7wjwvtfHaB-rEpLqd2xWFaPHGILY_vVab4TQjH3I5NT1EDSWdkjdOPTWlqw Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: e9c75d75a0ea45818f28071163cb93ad Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:26:28.904703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_e9c75d75a0ea45818f28071163cb93ad", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/e9c75d75a0ea45818f28071163cb93ad"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: e9c75d75a0ea45818f28071163cb93ad Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-912768496 Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesSnapshotsTestJSON-912768496-project Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: d32af5ae84b34f079b84bc416fb5b576 Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesSnapshotsTestJSON-912768496-project Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '73346829-e48a-4b12-8d99-68db6c32be36'} Jun 27 15:26:28.906674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. (HTTP 404) (Request-ID: req-877229d7-f480-4c2f-90f0-972632835135) Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:28.908920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:26:28.909800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:26:28.910641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-19008896-22fd-4c64-803b-2da6f2a8963b tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] Returning 404 to user: Volume 73346829-e48a-4b12-8d99-68db6c32be36 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-19008896-22fd-4c64-803b-2da6f2a8963b tempest-VolumesSnapshotsTestJSON-912768496 tempest-VolumesSnapshotsTestJSON-912768496-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36" status: 404 len: 109 microversion: 2.1 time: 0.082161 Jun 27 15:26:28.911480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 18/35] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:26:28 2022] GET /compute/v2.1/os-volumes/73346829-e48a-4b12-8d99-68db6c32be36 => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:26:29.561045 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1649982901", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "networks": [{"uuid": "ab1d5806-d663-4f8c-b8fa-c959f613968d"}]}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:26:29.941215 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] validate_networks() for [('ab1d5806-d663-4f8c-b8fa-c959f613968d', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:26:33.877029 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1942828037", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:26:34.251351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] validate_networks() for [('0dd13161-8ee5-4285-a373-761f6ed0abd7', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:26:35.734900 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:26:35.735498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:26:35.735791 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:26:35.736197 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:26:35.737448 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:26:35.789892 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:35.790343 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:35.791173 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:35.791611 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:35.932580 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Getting quotas for project 05e46da777a54cbe92cbfb00c37d8bb5. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:26:35.951467 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Getting quotas for user 5e2597ff867544f9953c519bf29a9bfa and project 05e46da777a54cbe92cbfb00c37d8bb5. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:26:36.002178 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:26:36.015467 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:26:36.279451 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8cd00ff6-58b0-4bec-91ad-e08c0072b5b4 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.437424 Jun 27 15:26:36.280885 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 18/36] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:26:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 7441 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:26:36.294893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-630bd845-8d90-4e5b-9264-90c57a995ba0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:36.295704 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-630bd845-8d90-4e5b-9264-90c57a995ba0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:36.988820 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-630bd845-8d90-4e5b-9264-90c57a995ba0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:37.026474 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-630bd845-8d90-4e5b-9264-90c57a995ba0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1215 microversion: 2.1 time: 0.738376 Jun 27 15:26:37.030614 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 19/37] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:36 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1215 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:26:38.058273 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:26:38.058989 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:26:38.059179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:26:38.062032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:26:38.063116 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ca7076f1-f0c5-40d6-ae53-bbf7dc3ef328 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:38.065036 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:26:38.066529 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ca7076f1-f0c5-40d6-ae53-bbf7dc3ef328 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:38.133710 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:38.144982 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:38.146121 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:38.151613 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:38.232515 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Getting quotas for project 2832173587a6494eb7f73b3ca0a09a0f. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:26:38.258002 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Getting quotas for user effe0200dc584f11923e83ed240138ff and project 2832173587a6494eb7f73b3ca0a09a0f. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:26:38.313954 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:26:38.317689 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:26:38.359680 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ca7076f1-f0c5-40d6-ae53-bbf7dc3ef328 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:38.368128 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ca7076f1-f0c5-40d6-ae53-bbf7dc3ef328 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1215 microversion: 2.1 time: 0.315903 Jun 27 15:26:38.375760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 20/38] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:38 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1215 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:26:38.623261 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-34ab9688-1d3b-4627-98a8-10f7abdc2bfe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 5.767594 Jun 27 15:26:38.624011 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:26:32 2022] POST /compute/v2.1/servers => generated 383 bytes in 5770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:26:38.638889 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-457725ac-5fb3-45b9-8779-29cd2cd3f184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:38.639640 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-457725ac-5fb3-45b9-8779-29cd2cd3f184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:39.410569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2e9ae043-7e34-40b1-82e8-97461303b765 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:39.411221 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2e9ae043-7e34-40b1-82e8-97461303b765 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:39.993087 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2e9ae043-7e34-40b1-82e8-97461303b765 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:40.116974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2e9ae043-7e34-40b1-82e8-97461303b765 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1215 microversion: 2.1 time: 0.706131 Jun 27 15:26:40.136402 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 20/40] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:39 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1215 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:26:40.181468 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-457725ac-5fb3-45b9-8779-29cd2cd3f184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:40.225689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-457725ac-5fb3-45b9-8779-29cd2cd3f184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1222 microversion: 2.1 time: 1.589080 Jun 27 15:26:40.233318 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 21/41] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:38 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1222 bytes in 1599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:40.698391 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1055407959", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:26:40.899204 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] validate_networks() for [('0dd13161-8ee5-4285-a373-761f6ed0abd7', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:26:41.153664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-57c3dd46-2e00-45ad-b5db-7ce080ea13f6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:41.163114 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-57c3dd46-2e00-45ad-b5db-7ce080ea13f6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:41.827329 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-57c3dd46-2e00-45ad-b5db-7ce080ea13f6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:41.875806 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-57c3dd46-2e00-45ad-b5db-7ce080ea13f6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1215 microversion: 2.1 time: 0.729041 Jun 27 15:26:41.880637 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 22/42] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:41 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1215 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:42.458050 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:26:42.459282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:26:42.459998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:26:42.460690 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:26:42.461386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:26:42.493452 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:42.506527 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:42.507694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:42.527345 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:42.633294 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Getting quotas for project 2832173587a6494eb7f73b3ca0a09a0f. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:26:42.661261 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Getting quotas for user effe0200dc584f11923e83ed240138ff and project 2832173587a6494eb7f73b3ca0a09a0f. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:26:42.707682 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:26:42.718868 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:26:43.103822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8ab30d8c-fca6-4655-8960-c6526e5c4a3c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.415411 Jun 27 15:26:43.122767 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 21/43] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:26:40 2022] POST /compute/v2.1/servers => generated 383 bytes in 2439 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:26:43.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-299a20da-7767-4804-9dae-fef15797432c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:43.162357 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-299a20da-7767-4804-9dae-fef15797432c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:43.203268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-299a20da-7767-4804-9dae-fef15797432c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:43.205054 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-299a20da-7767-4804-9dae-fef15797432c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:43.210881 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-299a20da-7767-4804-9dae-fef15797432c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:43.226751 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-299a20da-7767-4804-9dae-fef15797432c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:44.346460 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-299a20da-7767-4804-9dae-fef15797432c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:44.408964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-299a20da-7767-4804-9dae-fef15797432c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1267 microversion: 2.1 time: 1.277666 Jun 27 15:26:44.423061 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 22/44] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:43 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1267 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:44.436855 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ba8e55e1-ccff-4fe2-9334-4c357c959ca1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:44.440745 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ba8e55e1-ccff-4fe2-9334-4c357c959ca1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:44.729108 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a227299e-7039-4c87-8c8d-55558fe486a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'create', calling method: .version_select at 0x7fb278312af0>, body: {"keypair": {"name": "tempest-keypair-657700173", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLhL0vLpEnCWXaQ3SlrRHGEeWO9UoaN8l2thCmtgRofkUNDdD4ywSSMJTv8lcIVetykc/gzZAJnMojFFDNHjUzZAzHAP/yA6HbpsqGD90d9pGghNpk9HbkF3JDeDT8AwSA=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:26:44.754468 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ba8e55e1-ccff-4fe2-9334-4c357c959ca1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:44.781097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ba8e55e1-ccff-4fe2-9334-4c357c959ca1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1222 microversion: 2.1 time: 0.353478 Jun 27 15:26:44.789717 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-a227299e-7039-4c87-8c8d-55558fe486a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Getting quotas for project 2e07fc46cd5f4afe875767c926bd63ee. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:26:44.796663 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 23/45] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:44 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1222 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:44.803142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-a227299e-7039-4c87-8c8d-55558fe486a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Getting quotas for user 995fa1760f5241588a493e5f894b0e3f and project 2e07fc46cd5f4afe875767c926bd63ee. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:26:44.906494 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a227299e-7039-4c87-8c8d-55558fe486a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 2.163323 Jun 27 15:26:44.915713 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 23/46] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jun 27 15:26:42 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 2179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:26:45.354651 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4c53c298-b2b8-4b14-9c2d-c9aa9b3b0c50 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Action: 'create', calling method: .version_select at 0x7fb2782544c0>, body: {"keypair": {"name": "tempest-keypair-55710631", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLswgvDBaITfxOf+dUVGoaB5gJuoydr9SrVvS5qEr2/Fzkx08GqI10Lxobbomm2BqXUfw/o2TnA8PAkSMfDft7tLq9jfE8XmcVBtr2om5hO8ZXx+A5gAMu8w/tFzpD/UVg=="}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:26:45.438510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9f504d8e-0511-4a91-802f-f159f5606f51 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:45.443570 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9f504d8e-0511-4a91-802f-f159f5606f51 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:45.514108 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9f504d8e-0511-4a91-802f-f159f5606f51 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:45.514886 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9f504d8e-0511-4a91-802f-f159f5606f51 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:45.516305 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9f504d8e-0511-4a91-802f-f159f5606f51 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:45.532170 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-4c53c298-b2b8-4b14-9c2d-c9aa9b3b0c50 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Getting quotas for project 2270daf238a640609e9ab514b01d9768. Resources: {'key_pairs'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:26:45.533532 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9f504d8e-0511-4a91-802f-f159f5606f51 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:45.563190 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-4c53c298-b2b8-4b14-9c2d-c9aa9b3b0c50 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Getting quotas for user e9dab30db0a44655828384db53df29f9 and project 2270daf238a640609e9ab514b01d9768. Resources: {'key_pairs'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:26:45.756969 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4c53c298-b2b8-4b14-9c2d-c9aa9b3b0c50 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.955408 Jun 27 15:26:45.760802 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 24/47] 10.222.0.26 () {62 vars in 1199 bytes} [Mon Jun 27 15:26:44 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 963 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 27 15:26:45.805307 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-075de619-faa6-4289-8c5d-ccf79a26273d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:45.810205 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-075de619-faa6-4289-8c5d-ccf79a26273d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:45.857434 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-075de619-faa6-4289-8c5d-ccf79a26273d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:45.861074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-075de619-faa6-4289-8c5d-ccf79a26273d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:45.872585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-075de619-faa6-4289-8c5d-ccf79a26273d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:45.876505 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-075de619-faa6-4289-8c5d-ccf79a26273d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:45.932754 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:46.107609 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-075de619-faa6-4289-8c5d-ccf79a26273d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:46.128732 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-075de619-faa6-4289-8c5d-ccf79a26273d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1226 microversion: 2.1 time: 0.329024 Jun 27 15:26:46.129872 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 25/48] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:45 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1226 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:46.270721 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9f504d8e-0511-4a91-802f-f159f5606f51 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:46.317186 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9f504d8e-0511-4a91-802f-f159f5606f51 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1285 microversion: 2.1 time: 0.889055 Jun 27 15:26:46.335131 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 24/49] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:45 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1285 bytes in 894 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:26:47.178524 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-84de3b3f-b9c6-406e-99e1-2dfa21c02e0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:47.179705 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-84de3b3f-b9c6-406e-99e1-2dfa21c02e0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:47.229573 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-84de3b3f-b9c6-406e-99e1-2dfa21c02e0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:47.231697 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-84de3b3f-b9c6-406e-99e1-2dfa21c02e0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:47.235413 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-84de3b3f-b9c6-406e-99e1-2dfa21c02e0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:47.245056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-84de3b3f-b9c6-406e-99e1-2dfa21c02e0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:47.348569 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ec01c348-6d3b-4f42-888a-a02f2e7d4806 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:47.349238 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ec01c348-6d3b-4f42-888a-a02f2e7d4806 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:47.397011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec01c348-6d3b-4f42-888a-a02f2e7d4806 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:47.397939 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec01c348-6d3b-4f42-888a-a02f2e7d4806 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:47.404114 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec01c348-6d3b-4f42-888a-a02f2e7d4806 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:47.404967 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ec01c348-6d3b-4f42-888a-a02f2e7d4806 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:47.836574 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-84de3b3f-b9c6-406e-99e1-2dfa21c02e0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:47.887931 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-84de3b3f-b9c6-406e-99e1-2dfa21c02e0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1218 microversion: 2.1 time: 0.727900 Jun 27 15:26:47.891798 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 26/50] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:47 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1218 bytes in 733 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:48.796877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ec01c348-6d3b-4f42-888a-a02f2e7d4806 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:48.817434 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ec01c348-6d3b-4f42-888a-a02f2e7d4806 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1285 microversion: 2.1 time: 1.471614 Jun 27 15:26:48.820269 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 25/51] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:47 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1285 bytes in 1481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:48.918583 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-0e4f5b71-e762-4122-847d-2b9ae745b5f0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:48.929074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-0e4f5b71-e762-4122-847d-2b9ae745b5f0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:48.975988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0e4f5b71-e762-4122-847d-2b9ae745b5f0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:48.977819 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0e4f5b71-e762-4122-847d-2b9ae745b5f0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:48.985851 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0e4f5b71-e762-4122-847d-2b9ae745b5f0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:48.987599 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0e4f5b71-e762-4122-847d-2b9ae745b5f0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:49.727032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-0e4f5b71-e762-4122-847d-2b9ae745b5f0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:49.783284 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-0e4f5b71-e762-4122-847d-2b9ae745b5f0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1280 microversion: 2.1 time: 0.866992 Jun 27 15:26:49.798874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 27/52] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:48 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1280 bytes in 886 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:49.861173 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e8665535-7b29-4815-8d02-832a18f673f8 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:49.885615 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e8665535-7b29-4815-8d02-832a18f673f8 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:49.935627 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8665535-7b29-4815-8d02-832a18f673f8 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:49.936103 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8665535-7b29-4815-8d02-832a18f673f8 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:49.937013 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8665535-7b29-4815-8d02-832a18f673f8 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:49.937460 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e8665535-7b29-4815-8d02-832a18f673f8 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:50.293153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e8665535-7b29-4815-8d02-832a18f673f8 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:50.307115 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e8665535-7b29-4815-8d02-832a18f673f8 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1273 microversion: 2.1 time: 0.460512 Jun 27 15:26:50.328638 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 26/53] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:49 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1273 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:50.809035 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c6ceaf80-550e-4051-aa7f-5448c2dbcd46 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:50.810443 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-c6ceaf80-550e-4051-aa7f-5448c2dbcd46 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:50.835263 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c6ceaf80-550e-4051-aa7f-5448c2dbcd46 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:50.841150 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c6ceaf80-550e-4051-aa7f-5448c2dbcd46 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:50.844168 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c6ceaf80-550e-4051-aa7f-5448c2dbcd46 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:50.846879 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c6ceaf80-550e-4051-aa7f-5448c2dbcd46 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:51.349144 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-436014dc-e92d-4972-ad46-7d0afc6dbb20 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:51.350043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-436014dc-e92d-4972-ad46-7d0afc6dbb20 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:51.391088 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-436014dc-e92d-4972-ad46-7d0afc6dbb20 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:51.393936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-436014dc-e92d-4972-ad46-7d0afc6dbb20 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:51.400622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-436014dc-e92d-4972-ad46-7d0afc6dbb20 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:51.415323 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-436014dc-e92d-4972-ad46-7d0afc6dbb20 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:51.577123 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-c6ceaf80-550e-4051-aa7f-5448c2dbcd46 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:51.622951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c6ceaf80-550e-4051-aa7f-5448c2dbcd46 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1280 microversion: 2.1 time: 0.814154 Jun 27 15:26:51.632950 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 28/54] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:50 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1280 bytes in 830 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:52.382397 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-436014dc-e92d-4972-ad46-7d0afc6dbb20 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:52.394089 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-436014dc-e92d-4972-ad46-7d0afc6dbb20 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1273 microversion: 2.1 time: 1.068058 Jun 27 15:26:52.399445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 27/55] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:51 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1273 bytes in 1077 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:52.655536 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8daa054a-48aa-4e42-accb-553121716492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:52.657060 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8daa054a-48aa-4e42-accb-553121716492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:52.666086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=4 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:52.720299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8daa054a-48aa-4e42-accb-553121716492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:52.724959 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8daa054a-48aa-4e42-accb-553121716492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:52.748892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8daa054a-48aa-4e42-accb-553121716492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:52.766345 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8daa054a-48aa-4e42-accb-553121716492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:53.452785 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a23fe21d-a2d5-40bf-9e96-363dc929b5c5 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:53.460141 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a23fe21d-a2d5-40bf-9e96-363dc929b5c5 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:53.491343 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a23fe21d-a2d5-40bf-9e96-363dc929b5c5 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:53.494299 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a23fe21d-a2d5-40bf-9e96-363dc929b5c5 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:53.498348 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a23fe21d-a2d5-40bf-9e96-363dc929b5c5 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:53.500576 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a23fe21d-a2d5-40bf-9e96-363dc929b5c5 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:54.692357 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-8daa054a-48aa-4e42-accb-553121716492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:54.736233 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8daa054a-48aa-4e42-accb-553121716492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1280 microversion: 2.1 time: 2.081819 Jun 27 15:26:54.757613 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 29/56] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:52 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1280 bytes in 2107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:54.824191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=18 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:55.806614 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4cf5f3b0-6797-45f5-9532-ea7d51d7702a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:55.807549 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4cf5f3b0-6797-45f5-9532-ea7d51d7702a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:55.826730 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=20 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:55.827735 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=7 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:55.845093 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4cf5f3b0-6797-45f5-9532-ea7d51d7702a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:55.846558 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4cf5f3b0-6797-45f5-9532-ea7d51d7702a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:55.856138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4cf5f3b0-6797-45f5-9532-ea7d51d7702a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:55.861973 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4cf5f3b0-6797-45f5-9532-ea7d51d7702a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:56.064742 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a23fe21d-a2d5-40bf-9e96-363dc929b5c5 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:56.116572 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a23fe21d-a2d5-40bf-9e96-363dc929b5c5 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 2.691161 Jun 27 15:26:56.149882 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 28/57] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:53 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 2726 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:56.338098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4cf5f3b0-6797-45f5-9532-ea7d51d7702a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:56.383689 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4cf5f3b0-6797-45f5-9532-ea7d51d7702a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1280 microversion: 2.1 time: 0.596257 Jun 27 15:26:56.392453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-530973702", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42d6796f-0df3-4f1e-9bd2-00a387c5c9c3"}], "security_groups": [{"name": "tempest-securitygroup--811920952"}], "key_name": "tempest-keypair-657700173", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:26:56.407181 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 30/58] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:55 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1280 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:56.516131 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:26:57.166452 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-615285f1-49f3-4929-8455-a3e5209676d6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:57.167626 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-615285f1-49f3-4929-8455-a3e5209676d6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:57.230521 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-615285f1-49f3-4929-8455-a3e5209676d6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:57.231511 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-615285f1-49f3-4929-8455-a3e5209676d6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:57.238380 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-615285f1-49f3-4929-8455-a3e5209676d6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:57.242484 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-615285f1-49f3-4929-8455-a3e5209676d6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:58.389220 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] validate_networks() for [('42d6796f-0df3-4f1e-9bd2-00a387c5c9c3', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:26:59.392260 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-615285f1-49f3-4929-8455-a3e5209676d6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:26:59.424959 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-615285f1-49f3-4929-8455-a3e5209676d6 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 2.266352 Jun 27 15:26:59.426182 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:57 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 2269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:26:59.442558 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a55070b0-7b4f-4641-a12c-5c70f5391fad tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:26:59.455088 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a55070b0-7b4f-4641-a12c-5c70f5391fad tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:26:59.482293 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a55070b0-7b4f-4641-a12c-5c70f5391fad tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:59.487048 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a55070b0-7b4f-4641-a12c-5c70f5391fad tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:26:59.489382 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a55070b0-7b4f-4641-a12c-5c70f5391fad tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:26:59.497166 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a55070b0-7b4f-4641-a12c-5c70f5391fad tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:00.147180 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a55070b0-7b4f-4641-a12c-5c70f5391fad tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:00.164211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a55070b0-7b4f-4641-a12c-5c70f5391fad tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 0.736446 Jun 27 15:27:00.168292 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 32/60] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:26:59 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:00.182429 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-857147121", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8e77f3f-2787-4f23-b11e-9e909cc074b3"}], "security_groups": [{"name": "tempest-securitygroup--2111744474"}], "key_name": "tempest-keypair-55710631", "user_data": "}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:01.312816 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] validate_networks() for [('e8e77f3f-2787-4f23-b11e-9e909cc074b3', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:27:01.875264 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:27:01.875920 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:27:01.876443 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:27:01.877644 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:27:01.878512 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:27:01.904642 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:01.916459 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:01.918650 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:01.919523 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:01.996830 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Getting quotas for project 2e07fc46cd5f4afe875767c926bd63ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:27:02.004203 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Getting quotas for user 995fa1760f5241588a493e5f894b0e3f and project 2e07fc46cd5f4afe875767c926bd63ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:27:02.033677 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:27:02.062676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:27:02.169873 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-43c7c106-1086-43a3-8ec6-cac45759b01b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.812314 Jun 27 15:27:02.176553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 29/61] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:26:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 5821 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:27:02.182476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d19ccb44-0f4e-4040-a474-b202efbcb34e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:02.183504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d19ccb44-0f4e-4040-a474-b202efbcb34e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:02.193546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d19ccb44-0f4e-4040-a474-b202efbcb34e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:02.197821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d19ccb44-0f4e-4040-a474-b202efbcb34e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:02.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d19ccb44-0f4e-4040-a474-b202efbcb34e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:02.201007 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d19ccb44-0f4e-4040-a474-b202efbcb34e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:03.286931 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d19ccb44-0f4e-4040-a474-b202efbcb34e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:03.295869 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d19ccb44-0f4e-4040-a474-b202efbcb34e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 1.117567 Jun 27 15:27:03.300087 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 30/62] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:02 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 1123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:03.326902 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3bc13101-38c3-4302-9260-315e59edc54d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:03.329015 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3bc13101-38c3-4302-9260-315e59edc54d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:03.355597 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3bc13101-38c3-4302-9260-315e59edc54d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:03.359588 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3bc13101-38c3-4302-9260-315e59edc54d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:03.363829 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3bc13101-38c3-4302-9260-315e59edc54d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:03.365088 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3bc13101-38c3-4302-9260-315e59edc54d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:03.890827 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:27:03.891569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:27:03.891745 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:27:03.892160 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:27:03.892984 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:27:03.913229 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:03.915346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:03.916695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:03.925903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:03.954504 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Getting quotas for project 2270daf238a640609e9ab514b01d9768. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:27:03.960595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Getting quotas for user e9dab30db0a44655828384db53df29f9 and project 2270daf238a640609e9ab514b01d9768. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:27:03.981725 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:27:03.985270 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:27:04.061481 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-692fc909-e18e-452c-a2ce-351f8373aefe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.891172 Jun 27 15:27:04.065922 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 33/63] 10.222.0.26 () {62 vars in 1187 bytes} [Mon Jun 27 15:27:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 3897 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 15:27:04.073262 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-23b236f9-49bf-4023-837f-97f7ba0c416f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:04.074256 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-23b236f9-49bf-4023-837f-97f7ba0c416f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:04.083721 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23b236f9-49bf-4023-837f-97f7ba0c416f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:04.084712 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23b236f9-49bf-4023-837f-97f7ba0c416f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:04.085783 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23b236f9-49bf-4023-837f-97f7ba0c416f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:04.086682 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23b236f9-49bf-4023-837f-97f7ba0c416f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:04.211260 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-23b236f9-49bf-4023-837f-97f7ba0c416f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:04.226491 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-23b236f9-49bf-4023-837f-97f7ba0c416f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1240 microversion: 2.1 time: 0.158703 Jun 27 15:27:04.229104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 34/64] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:04 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1240 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:04.623799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-85a3cf0c-77b9-4ae5-9af3-1e262290136f req-2c2554e8-59fe-4e20-9e38-c7e22987135c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05ad818a-43eb-47d0-a466-eeeec96fd758", "tag": "d3ed4003-b3bf-4b78-872f-0deb501c8889"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:04.674864 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-85a3cf0c-77b9-4ae5-9af3-1e262290136f req-2c2554e8-59fe-4e20-9e38-c7e22987135c service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:04.676784 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-85a3cf0c-77b9-4ae5-9af3-1e262290136f req-2c2554e8-59fe-4e20-9e38-c7e22987135c service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:04.704378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-85a3cf0c-77b9-4ae5-9af3-1e262290136f req-2c2554e8-59fe-4e20-9e38-c7e22987135c service nova] Creating event network-changed:d3ed4003-b3bf-4b78-872f-0deb501c8889 for instance 05ad818a-43eb-47d0-a466-eeeec96fd758 on hv-cinder-84779 Jun 27 15:27:04.709056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-85a3cf0c-77b9-4ae5-9af3-1e262290136f req-2c2554e8-59fe-4e20-9e38-c7e22987135c service nova] Acquired lock "compute-rpcapi-router" {{(pid=117977) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 15:27:04.709056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-290c0a57-81f6-4f60-82f9-9ed708ee6fd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:04.709056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-290c0a57-81f6-4f60-82f9-9ed708ee6fd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:04.709056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-290c0a57-81f6-4f60-82f9-9ed708ee6fd9 None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:04.709546 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-290c0a57-81f6-4f60-82f9-9ed708ee6fd9 None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:04.720621 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3bc13101-38c3-4302-9260-315e59edc54d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:04.729807 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.compute.rpcapi [None req-290c0a57-81f6-4f60-82f9-9ed708ee6fd9 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 15:27:04.731408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3bc13101-38c3-4302-9260-315e59edc54d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 1.420382 Jun 27 15:27:04.731971 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-290c0a57-81f6-4f60-82f9-9ed708ee6fd9 None None] Releasing lock "compute-rpcapi-router" {{(pid=117977) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 15:27:04.742304 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 31/65] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:03 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 1441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:04.780721 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-290c0a57-81f6-4f60-82f9-9ed708ee6fd9 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.548656 Jun 27 15:27:04.782208 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 35/66] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:04.792263 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a9851d35-a619-4e0f-84ec-f9bd435bdc38 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:04.795857 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a9851d35-a619-4e0f-84ec-f9bd435bdc38 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:05.147155 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-8d1495b8-8aab-4d06-95c0-8a95dcc74e72 req-0b2296df-f44f-4ab9-82ff-78d9927034aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7aa7f3fe-5f45-46ca-960d-1c77079dceb6", "tag": "6589e017-7d15-4438-86e5-e3a74e6999a7"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:05.194153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-8d1495b8-8aab-4d06-95c0-8a95dcc74e72 req-0b2296df-f44f-4ab9-82ff-78d9927034aa service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:05.195829 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-8d1495b8-8aab-4d06-95c0-8a95dcc74e72 req-0b2296df-f44f-4ab9-82ff-78d9927034aa service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:05.321282 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-8d1495b8-8aab-4d06-95c0-8a95dcc74e72 req-0b2296df-f44f-4ab9-82ff-78d9927034aa service nova] Creating event network-changed:6589e017-7d15-4438-86e5-e3a74e6999a7 for instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 on hv-cinder-84779 Jun 27 15:27:05.322362 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-8d1495b8-8aab-4d06-95c0-8a95dcc74e72 req-0b2296df-f44f-4ab9-82ff-78d9927034aa service nova] Acquired lock "compute-rpcapi-router" {{(pid=117978) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 15:27:05.338816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be0be264-5fb5-4376-816a-fa340a33b26d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:05.350264 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be0be264-5fb5-4376-816a-fa340a33b26d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:05.354546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be0be264-5fb5-4376-816a-fa340a33b26d None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:05.355523 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be0be264-5fb5-4376-816a-fa340a33b26d None None] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:05.427232 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.compute.rpcapi [None req-be0be264-5fb5-4376-816a-fa340a33b26d None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 15:27:05.429881 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be0be264-5fb5-4376-816a-fa340a33b26d None None] Releasing lock "compute-rpcapi-router" {{(pid=117978) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 15:27:05.484262 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-be0be264-5fb5-4376-816a-fa340a33b26d None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.739555 Jun 27 15:27:05.485876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 32/67] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:05.509902 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3b8b78c8-6274-4003-9f28-80c03d8c5fb0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:05.511386 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3b8b78c8-6274-4003-9f28-80c03d8c5fb0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:05.534737 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b8b78c8-6274-4003-9f28-80c03d8c5fb0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:05.535658 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b8b78c8-6274-4003-9f28-80c03d8c5fb0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:05.537567 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b8b78c8-6274-4003-9f28-80c03d8c5fb0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:05.538484 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b8b78c8-6274-4003-9f28-80c03d8c5fb0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:05.819733 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a9851d35-a619-4e0f-84ec-f9bd435bdc38 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:05.838622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a9851d35-a619-4e0f-84ec-f9bd435bdc38 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:05.843957 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a9851d35-a619-4e0f-84ec-f9bd435bdc38 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:05.847803 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a9851d35-a619-4e0f-84ec-f9bd435bdc38 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1279 microversion: 2.20 time: 1.063795 Jun 27 15:27:05.850828 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 36/68] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:04 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1279 bytes in 1067 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:05.865224 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-dd34dad3-0ef9-4345-9635-9661f35b94db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:05.866957 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-dd34dad3-0ef9-4345-9635-9661f35b94db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:05.886668 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dd34dad3-0ef9-4345-9635-9661f35b94db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:05.887991 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dd34dad3-0ef9-4345-9635-9661f35b94db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:05.890379 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dd34dad3-0ef9-4345-9635-9661f35b94db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:05.891531 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dd34dad3-0ef9-4345-9635-9661f35b94db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:05.908512 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=71 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:06.583208 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3b8b78c8-6274-4003-9f28-80c03d8c5fb0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:06.606186 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=55 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:06.610624 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3b8b78c8-6274-4003-9f28-80c03d8c5fb0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 1.120882 Jun 27 15:27:06.611896 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 33/69] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:05 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:06.641332 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2dca8abf-1740-416f-93c3-2525a1b0d5e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:06.642621 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2dca8abf-1740-416f-93c3-2525a1b0d5e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:06.659648 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2dca8abf-1740-416f-93c3-2525a1b0d5e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:06.673575 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-dd34dad3-0ef9-4345-9635-9661f35b94db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:06.675946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2dca8abf-1740-416f-93c3-2525a1b0d5e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:06.684310 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2dca8abf-1740-416f-93c3-2525a1b0d5e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:06.685875 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2dca8abf-1740-416f-93c3-2525a1b0d5e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:06.725072 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-dd34dad3-0ef9-4345-9635-9661f35b94db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1288 microversion: 2.1 time: 0.871060 Jun 27 15:27:06.735929 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 37/70] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:05 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1288 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:06.928758 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e2328514-21c0-4e35-b70e-069e6ab9065b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:06.934358 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e2328514-21c0-4e35-b70e-069e6ab9065b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:06.973223 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e2328514-21c0-4e35-b70e-069e6ab9065b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:06.975745 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e2328514-21c0-4e35-b70e-069e6ab9065b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:06.978578 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e2328514-21c0-4e35-b70e-069e6ab9065b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:06.981326 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e2328514-21c0-4e35-b70e-069e6ab9065b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:08.023816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2dca8abf-1740-416f-93c3-2525a1b0d5e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:08.045027 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2dca8abf-1740-416f-93c3-2525a1b0d5e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 1.431439 Jun 27 15:27:08.050946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 34/71] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:06 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:08.082052 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-3cd397ae-a241-4350-9b87-f109c13a0d6a req-bd1ed6a3-d416-431d-9ec8-fafc3beaab74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a", "tag": "05ebe349-4d00-4c7d-9c0d-a92627d5285d"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:08.095978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e2328514-21c0-4e35-b70e-069e6ab9065b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:08.133095 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-3cd397ae-a241-4350-9b87-f109c13a0d6a req-bd1ed6a3-d416-431d-9ec8-fafc3beaab74 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:08.135896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e2328514-21c0-4e35-b70e-069e6ab9065b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:08.137751 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-3cd397ae-a241-4350-9b87-f109c13a0d6a req-bd1ed6a3-d416-431d-9ec8-fafc3beaab74 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:08.151081 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e2328514-21c0-4e35-b70e-069e6ab9065b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:08.155495 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e2328514-21c0-4e35-b70e-069e6ab9065b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1331 microversion: 2.20 time: 1.280341 Jun 27 15:27:08.186831 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 38/72] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:06 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1331 bytes in 1316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:08.199408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c3c80745-095a-441e-a273-393c895b656e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:08.201294 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-3cd397ae-a241-4350-9b87-f109c13a0d6a req-bd1ed6a3-d416-431d-9ec8-fafc3beaab74 service nova] Creating event network-changed:05ebe349-4d00-4c7d-9c0d-a92627d5285d for instance c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a on hv-cinder-84779 Jun 27 15:27:08.201797 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-c3c80745-095a-441e-a273-393c895b656e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:08.217263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-3cd397ae-a241-4350-9b87-f109c13a0d6a req-bd1ed6a3-d416-431d-9ec8-fafc3beaab74 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.161428 Jun 27 15:27:08.222503 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 35/73] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:08.227510 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c3c80745-095a-441e-a273-393c895b656e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:08.234399 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c3c80745-095a-441e-a273-393c895b656e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:08.236899 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-822a2a26-4c3e-4141-b1e2-7c9154f0aa11 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:08.239131 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c3c80745-095a-441e-a273-393c895b656e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:08.241548 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c3c80745-095a-441e-a273-393c895b656e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:08.249368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-822a2a26-4c3e-4141-b1e2-7c9154f0aa11 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:08.273706 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-822a2a26-4c3e-4141-b1e2-7c9154f0aa11 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:08.278535 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-822a2a26-4c3e-4141-b1e2-7c9154f0aa11 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:08.279448 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-822a2a26-4c3e-4141-b1e2-7c9154f0aa11 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:08.281144 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-822a2a26-4c3e-4141-b1e2-7c9154f0aa11 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:08.534953 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-822a2a26-4c3e-4141-b1e2-7c9154f0aa11 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:08.549461 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-822a2a26-4c3e-4141-b1e2-7c9154f0aa11 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1294 microversion: 2.1 time: 0.324943 Jun 27 15:27:08.564243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 36/74] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:08 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1294 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:09.075591 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1e72ca8b-f063-429f-9355-d68395c46ccf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:09.078989 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1e72ca8b-f063-429f-9355-d68395c46ccf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:09.101931 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e72ca8b-f063-429f-9355-d68395c46ccf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:09.105256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e72ca8b-f063-429f-9355-d68395c46ccf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:09.108783 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e72ca8b-f063-429f-9355-d68395c46ccf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:09.110626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1e72ca8b-f063-429f-9355-d68395c46ccf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:09.727240 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-c3c80745-095a-441e-a273-393c895b656e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:09.745256 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c3c80745-095a-441e-a273-393c895b656e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 1.554060 Jun 27 15:27:09.746217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 39/75] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:08 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 1559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:09.762056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-18a1a9b2-4ab2-450b-b85e-d77ce15cdc32 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:09.763978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-18a1a9b2-4ab2-450b-b85e-d77ce15cdc32 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:09.784058 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18a1a9b2-4ab2-450b-b85e-d77ce15cdc32 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:09.784960 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18a1a9b2-4ab2-450b-b85e-d77ce15cdc32 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:09.786197 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18a1a9b2-4ab2-450b-b85e-d77ce15cdc32 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:09.790745 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18a1a9b2-4ab2-450b-b85e-d77ce15cdc32 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:09.981520 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1e72ca8b-f063-429f-9355-d68395c46ccf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:10.003801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1e72ca8b-f063-429f-9355-d68395c46ccf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 0.936416 Jun 27 15:27:10.016750 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 37/76] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:09 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:10.024086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-78272b77-b448-4461-bb20-414cd348bd0e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:10.025212 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-78272b77-b448-4461-bb20-414cd348bd0e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:10.032818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78272b77-b448-4461-bb20-414cd348bd0e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:10.034965 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78272b77-b448-4461-bb20-414cd348bd0e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:10.036117 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78272b77-b448-4461-bb20-414cd348bd0e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:10.036965 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78272b77-b448-4461-bb20-414cd348bd0e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:10.091753 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-18a1a9b2-4ab2-450b-b85e-d77ce15cdc32 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:10.113088 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-18a1a9b2-4ab2-450b-b85e-d77ce15cdc32 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:10.115150 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-18a1a9b2-4ab2-450b-b85e-d77ce15cdc32 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:10.121718 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-18a1a9b2-4ab2-450b-b85e-d77ce15cdc32 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1337 microversion: 2.20 time: 0.372914 Jun 27 15:27:10.138204 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 40/77] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:09 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1337 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:10.202695 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-78272b77-b448-4461-bb20-414cd348bd0e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:10.221123 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-78272b77-b448-4461-bb20-414cd348bd0e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1294 microversion: 2.1 time: 0.202890 Jun 27 15:27:10.221760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 38/78] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:10 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1294 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:10.765370 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-99ab7e53-481f-4281-a5cd-d91379e246ae tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:10.766363 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-99ab7e53-481f-4281-a5cd-d91379e246ae tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:10.773745 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-99ab7e53-481f-4281-a5cd-d91379e246ae tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:10.774574 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-99ab7e53-481f-4281-a5cd-d91379e246ae tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:10.775903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-99ab7e53-481f-4281-a5cd-d91379e246ae tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:10.776642 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-99ab7e53-481f-4281-a5cd-d91379e246ae tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:11.024043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-835c4bdc-6023-46ff-b871-a7e7f6df06ba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:11.024590 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-835c4bdc-6023-46ff-b871-a7e7f6df06ba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:11.038323 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-835c4bdc-6023-46ff-b871-a7e7f6df06ba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:11.039395 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-835c4bdc-6023-46ff-b871-a7e7f6df06ba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:11.043145 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-835c4bdc-6023-46ff-b871-a7e7f6df06ba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:11.044035 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-835c4bdc-6023-46ff-b871-a7e7f6df06ba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:11.253223 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-835c4bdc-6023-46ff-b871-a7e7f6df06ba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:11.274339 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-835c4bdc-6023-46ff-b871-a7e7f6df06ba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 0.255116 Jun 27 15:27:11.288926 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-99ab7e53-481f-4281-a5cd-d91379e246ae tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:11.302260 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 39/79] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:11 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:11.308310 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f09a20a2-097b-431a-a838-28315fbd9200 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:11.309854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-99ab7e53-481f-4281-a5cd-d91379e246ae tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 0.540960 Jun 27 15:27:11.322850 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 41/80] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:10 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:11.330107 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f09a20a2-097b-431a-a838-28315fbd9200 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:11.334191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-026016f7-dd9f-4bcb-b3f3-670d2fe8bf14 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:11.334894 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-026016f7-dd9f-4bcb-b3f3-670d2fe8bf14 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:11.340545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f09a20a2-097b-431a-a838-28315fbd9200 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:11.344778 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-026016f7-dd9f-4bcb-b3f3-670d2fe8bf14 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:11.344778 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-026016f7-dd9f-4bcb-b3f3-670d2fe8bf14 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:11.345114 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-026016f7-dd9f-4bcb-b3f3-670d2fe8bf14 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:11.345727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-026016f7-dd9f-4bcb-b3f3-670d2fe8bf14 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:11.347615 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f09a20a2-097b-431a-a838-28315fbd9200 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:11.349899 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f09a20a2-097b-431a-a838-28315fbd9200 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:11.350524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f09a20a2-097b-431a-a838-28315fbd9200 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:11.452692 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f09a20a2-097b-431a-a838-28315fbd9200 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:11.463883 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f09a20a2-097b-431a-a838-28315fbd9200 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:11.466797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f09a20a2-097b-431a-a838-28315fbd9200 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:11.468403 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f09a20a2-097b-431a-a838-28315fbd9200 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1337 microversion: 2.20 time: 0.165026 Jun 27 15:27:11.473487 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 40/81] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:11 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1337 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:11.531458 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-026016f7-dd9f-4bcb-b3f3-670d2fe8bf14 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:11.542083 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-026016f7-dd9f-4bcb-b3f3-670d2fe8bf14 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1294 microversion: 2.1 time: 0.217325 Jun 27 15:27:11.544283 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 42/82] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:11 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1294 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:12.297102 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4b9f0f45-97fb-4ef6-bede-fc998c54a2f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:12.298179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4b9f0f45-97fb-4ef6-bede-fc998c54a2f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:12.305206 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:12.329588 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8dc3231e-bfc7-44e2-9ca1-8a2912246fee tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:12.331925 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8dc3231e-bfc7-44e2-9ca1-8a2912246fee tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:12.350514 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b9f0f45-97fb-4ef6-bede-fc998c54a2f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:12.351220 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b9f0f45-97fb-4ef6-bede-fc998c54a2f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:12.352143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8dc3231e-bfc7-44e2-9ca1-8a2912246fee tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:12.352504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b9f0f45-97fb-4ef6-bede-fc998c54a2f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:12.353200 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b9f0f45-97fb-4ef6-bede-fc998c54a2f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:12.355595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8dc3231e-bfc7-44e2-9ca1-8a2912246fee tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:12.359019 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8dc3231e-bfc7-44e2-9ca1-8a2912246fee tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:12.360476 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8dc3231e-bfc7-44e2-9ca1-8a2912246fee tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:13.086014 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4b9f0f45-97fb-4ef6-bede-fc998c54a2f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:13.096513 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4b9f0f45-97fb-4ef6-bede-fc998c54a2f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 0.806477 Jun 27 15:27:13.097669 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 41/83] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:12 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:13.102893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e3059079-22cf-4c9b-b4c7-a9764beee483 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:13.103522 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e3059079-22cf-4c9b-b4c7-a9764beee483 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:13.110475 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3059079-22cf-4c9b-b4c7-a9764beee483 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:13.110753 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3059079-22cf-4c9b-b4c7-a9764beee483 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:13.111670 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3059079-22cf-4c9b-b4c7-a9764beee483 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:13.112176 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3059079-22cf-4c9b-b4c7-a9764beee483 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:13.347943 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e3059079-22cf-4c9b-b4c7-a9764beee483 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:13.359433 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e3059079-22cf-4c9b-b4c7-a9764beee483 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:13.361031 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e3059079-22cf-4c9b-b4c7-a9764beee483 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:13.362569 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e3059079-22cf-4c9b-b4c7-a9764beee483 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.263398 Jun 27 15:27:13.363380 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 42/84] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:13 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:13.372003 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2049a54b-34a2-4c72-92a9-a3f202828b7f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:13.372682 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2049a54b-34a2-4c72-92a9-a3f202828b7f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:13.392357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2049a54b-34a2-4c72-92a9-a3f202828b7f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:13.393083 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2049a54b-34a2-4c72-92a9-a3f202828b7f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:13.393877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2049a54b-34a2-4c72-92a9-a3f202828b7f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:13.401316 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2049a54b-34a2-4c72-92a9-a3f202828b7f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:13.736297 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2049a54b-34a2-4c72-92a9-a3f202828b7f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:13.765695 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2049a54b-34a2-4c72-92a9-a3f202828b7f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.399107 Jun 27 15:27:13.767236 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 43/85] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:13 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:13.912302 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-8dc3231e-bfc7-44e2-9ca1-8a2912246fee tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:13.928154 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8dc3231e-bfc7-44e2-9ca1-8a2912246fee tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 1.603106 Jun 27 15:27:13.929498 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 43/86] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:12 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 1606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:14.116006 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0ad0b7c2-bcf9-411c-a54e-7160e2ffe9c0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:14.117098 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0ad0b7c2-bcf9-411c-a54e-7160e2ffe9c0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:14.139578 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ad0b7c2-bcf9-411c-a54e-7160e2ffe9c0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:14.140723 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ad0b7c2-bcf9-411c-a54e-7160e2ffe9c0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:14.142273 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ad0b7c2-bcf9-411c-a54e-7160e2ffe9c0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:14.143327 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ad0b7c2-bcf9-411c-a54e-7160e2ffe9c0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:14.390715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-23a64f58-c2dc-4d2e-99bc-a5d9cf3cb4da tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:14.391572 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-23a64f58-c2dc-4d2e-99bc-a5d9cf3cb4da tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:14.403216 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23a64f58-c2dc-4d2e-99bc-a5d9cf3cb4da tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:14.404352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23a64f58-c2dc-4d2e-99bc-a5d9cf3cb4da tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:14.405614 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23a64f58-c2dc-4d2e-99bc-a5d9cf3cb4da tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:14.406101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23a64f58-c2dc-4d2e-99bc-a5d9cf3cb4da tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:14.503776 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0ad0b7c2-bcf9-411c-a54e-7160e2ffe9c0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:14.521383 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0ad0b7c2-bcf9-411c-a54e-7160e2ffe9c0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 0.410693 Jun 27 15:27:14.537488 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 44/87] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:14 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:14.719345 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=4 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:14.791509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-47b994d2-2e95-4c23-93af-66e85fc45064 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:14.793178 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-47b994d2-2e95-4c23-93af-66e85fc45064 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:14.811331 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47b994d2-2e95-4c23-93af-66e85fc45064 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:14.812422 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47b994d2-2e95-4c23-93af-66e85fc45064 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:14.815062 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47b994d2-2e95-4c23-93af-66e85fc45064 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:14.817027 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47b994d2-2e95-4c23-93af-66e85fc45064 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:14.844532 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-23a64f58-c2dc-4d2e-99bc-a5d9cf3cb4da tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:14.859356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-23a64f58-c2dc-4d2e-99bc-a5d9cf3cb4da tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:14.869604 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-23a64f58-c2dc-4d2e-99bc-a5d9cf3cb4da tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:14.870545 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-23a64f58-c2dc-4d2e-99bc-a5d9cf3cb4da tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.483889 Jun 27 15:27:14.888411 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 44/88] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:14 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:27:14.951505 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a49307b2-8607-47df-b20f-c90105aaa7f3 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:14.952510 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a49307b2-8607-47df-b20f-c90105aaa7f3 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:14.965021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a49307b2-8607-47df-b20f-c90105aaa7f3 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:14.965602 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a49307b2-8607-47df-b20f-c90105aaa7f3 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:14.967045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a49307b2-8607-47df-b20f-c90105aaa7f3 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:14.972691 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a49307b2-8607-47df-b20f-c90105aaa7f3 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:15.334524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-47b994d2-2e95-4c23-93af-66e85fc45064 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:15.352518 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-47b994d2-2e95-4c23-93af-66e85fc45064 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.570745 Jun 27 15:27:15.354147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 45/89] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:14 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 574 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:15.567081 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-08ff87a6-3723-44c7-ad6c-8e63314935b3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:15.567801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-08ff87a6-3723-44c7-ad6c-8e63314935b3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:15.571802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:15.594355 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08ff87a6-3723-44c7-ad6c-8e63314935b3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:15.594903 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08ff87a6-3723-44c7-ad6c-8e63314935b3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:15.595752 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08ff87a6-3723-44c7-ad6c-8e63314935b3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:15.598389 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08ff87a6-3723-44c7-ad6c-8e63314935b3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:15.668845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a49307b2-8607-47df-b20f-c90105aaa7f3 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:15.691790 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a49307b2-8607-47df-b20f-c90105aaa7f3 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 0.745061 Jun 27 15:27:15.694057 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 45/90] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:14 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:15.878388 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-08ff87a6-3723-44c7-ad6c-8e63314935b3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:15.894679 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-08ff87a6-3723-44c7-ad6c-8e63314935b3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 0.350402 Jun 27 15:27:15.895892 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 46/91] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:15 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:15.908152 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d8187b3f-75c0-4c69-94ad-1ce28d1e2205 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:15.910017 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d8187b3f-75c0-4c69-94ad-1ce28d1e2205 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:15.919589 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=8 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:15.938948 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d8187b3f-75c0-4c69-94ad-1ce28d1e2205 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:15.944712 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d8187b3f-75c0-4c69-94ad-1ce28d1e2205 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:15.946368 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d8187b3f-75c0-4c69-94ad-1ce28d1e2205 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:15.953740 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d8187b3f-75c0-4c69-94ad-1ce28d1e2205 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:16.146826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-dda6e7ec-01a7-4189-939b-ba313c83a7bc req-a9389bcf-666b-41ac-92e1-0cfb2e0c7043 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831291d0-f04d-4927-afcd-88fd058db642", "tag": "62696634-23e0-4313-bcf8-d3be6665d3aa"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:16.183195 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-dda6e7ec-01a7-4189-939b-ba313c83a7bc req-a9389bcf-666b-41ac-92e1-0cfb2e0c7043 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:16.183924 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-dda6e7ec-01a7-4189-939b-ba313c83a7bc req-a9389bcf-666b-41ac-92e1-0cfb2e0c7043 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:16.213859 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-dda6e7ec-01a7-4189-939b-ba313c83a7bc req-a9389bcf-666b-41ac-92e1-0cfb2e0c7043 service nova] Creating event network-changed:62696634-23e0-4313-bcf8-d3be6665d3aa for instance 831291d0-f04d-4927-afcd-88fd058db642 on hv-cinder-84779 Jun 27 15:27:16.228002 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-dda6e7ec-01a7-4189-939b-ba313c83a7bc req-a9389bcf-666b-41ac-92e1-0cfb2e0c7043 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089316 Jun 27 15:27:16.229619 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 47/92] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:27:16.405646 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-05c754ee-0e72-4ecc-901d-fb44951f7e1a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:16.410785 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-05c754ee-0e72-4ecc-901d-fb44951f7e1a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:16.449031 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-05c754ee-0e72-4ecc-901d-fb44951f7e1a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:16.455842 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-05c754ee-0e72-4ecc-901d-fb44951f7e1a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:16.456904 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-05c754ee-0e72-4ecc-901d-fb44951f7e1a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:16.459227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-05c754ee-0e72-4ecc-901d-fb44951f7e1a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:16.759433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d8187b3f-75c0-4c69-94ad-1ce28d1e2205 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:16.770604 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d8187b3f-75c0-4c69-94ad-1ce28d1e2205 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:16.772414 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d8187b3f-75c0-4c69-94ad-1ce28d1e2205 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:16.774968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d8187b3f-75c0-4c69-94ad-1ce28d1e2205 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.874480 Jun 27 15:27:16.785606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 46/93] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:15 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:16.803916 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-05c754ee-0e72-4ecc-901d-fb44951f7e1a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:16.825130 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e5a48b6b-c563-421e-9ab3-5c10a1384423 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:16.826161 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e5a48b6b-c563-421e-9ab3-5c10a1384423 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:16.826626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-05c754ee-0e72-4ecc-901d-fb44951f7e1a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.442918 Jun 27 15:27:16.828041 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 48/94] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:16 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:16.856755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e5a48b6b-c563-421e-9ab3-5c10a1384423 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:16.858054 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e5a48b6b-c563-421e-9ab3-5c10a1384423 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:16.861539 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e5a48b6b-c563-421e-9ab3-5c10a1384423 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:16.864605 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e5a48b6b-c563-421e-9ab3-5c10a1384423 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:16.920036 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-449727dd-c055-4262-82d5-bb96ed2d3492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:16.921384 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-449727dd-c055-4262-82d5-bb96ed2d3492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:16.931801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-449727dd-c055-4262-82d5-bb96ed2d3492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:16.932825 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-449727dd-c055-4262-82d5-bb96ed2d3492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:16.933985 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-449727dd-c055-4262-82d5-bb96ed2d3492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:16.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-449727dd-c055-4262-82d5-bb96ed2d3492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:17.055869 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e5a48b6b-c563-421e-9ab3-5c10a1384423 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:17.074585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e5a48b6b-c563-421e-9ab3-5c10a1384423 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 0.287365 Jun 27 15:27:17.075612 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 47/95] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:16 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:17.131802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-449727dd-c055-4262-82d5-bb96ed2d3492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:17.140218 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-449727dd-c055-4262-82d5-bb96ed2d3492 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 0.231317 Jun 27 15:27:17.140859 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 49/96] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:16 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:17.799340 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2cb90ced-5e0f-4bf4-8eee-59a4e1ccf6e7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:17.799340 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2cb90ced-5e0f-4bf4-8eee-59a4e1ccf6e7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:17.808940 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2cb90ced-5e0f-4bf4-8eee-59a4e1ccf6e7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:17.810177 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2cb90ced-5e0f-4bf4-8eee-59a4e1ccf6e7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:17.811526 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2cb90ced-5e0f-4bf4-8eee-59a4e1ccf6e7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:17.812718 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2cb90ced-5e0f-4bf4-8eee-59a4e1ccf6e7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:17.854489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-373917dd-36e9-4bf5-9750-5107655f7243 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:17.855454 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-373917dd-36e9-4bf5-9750-5107655f7243 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:17.866654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-373917dd-36e9-4bf5-9750-5107655f7243 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:17.867766 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-373917dd-36e9-4bf5-9750-5107655f7243 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:17.869478 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-373917dd-36e9-4bf5-9750-5107655f7243 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:17.870519 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-373917dd-36e9-4bf5-9750-5107655f7243 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:18.156737 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-373917dd-36e9-4bf5-9750-5107655f7243 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:18.181153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-373917dd-36e9-4bf5-9750-5107655f7243 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.338660 Jun 27 15:27:18.183365 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 50/97] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:17 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:18.192787 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2520ef31-83c4-4c50-990d-740381ef354b tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:18.194509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2520ef31-83c4-4c50-990d-740381ef354b tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:18.208113 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2520ef31-83c4-4c50-990d-740381ef354b tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:18.209456 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2520ef31-83c4-4c50-990d-740381ef354b tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:18.211328 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2520ef31-83c4-4c50-990d-740381ef354b tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:18.212581 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2520ef31-83c4-4c50-990d-740381ef354b tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:18.556722 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2520ef31-83c4-4c50-990d-740381ef354b tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:18.560750 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:18.571171 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2520ef31-83c4-4c50-990d-740381ef354b tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 0.385380 Jun 27 15:27:18.572187 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 51/98] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:18 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:18.578453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3a2ce5fd-deb0-494f-a69e-4ee054f5f278 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:18.578748 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3a2ce5fd-deb0-494f-a69e-4ee054f5f278 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:18.586999 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a2ce5fd-deb0-494f-a69e-4ee054f5f278 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:18.587448 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a2ce5fd-deb0-494f-a69e-4ee054f5f278 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:18.588242 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a2ce5fd-deb0-494f-a69e-4ee054f5f278 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:18.588808 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a2ce5fd-deb0-494f-a69e-4ee054f5f278 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:18.620751 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2cb90ced-5e0f-4bf4-8eee-59a4e1ccf6e7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:18.652390 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2cb90ced-5e0f-4bf4-8eee-59a4e1ccf6e7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:18.673657 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2cb90ced-5e0f-4bf4-8eee-59a4e1ccf6e7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:18.676499 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2cb90ced-5e0f-4bf4-8eee-59a4e1ccf6e7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.886455 Jun 27 15:27:18.692057 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 48/99] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:17 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:18.697528 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-27229fba-2e74-49c6-b948-1a14160668ac req-dea32d50-092d-48fc-882a-980fdeeae428 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53705ab2-462b-4198-8565-c1ad2fbf535d", "tag": "309f419d-b0d1-4868-a4ca-ca1976451588"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:18.715522 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-27229fba-2e74-49c6-b948-1a14160668ac req-dea32d50-092d-48fc-882a-980fdeeae428 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:18.718623 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-27229fba-2e74-49c6-b948-1a14160668ac req-dea32d50-092d-48fc-882a-980fdeeae428 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:18.758392 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-27229fba-2e74-49c6-b948-1a14160668ac req-dea32d50-092d-48fc-882a-980fdeeae428 service nova] Creating event network-changed:309f419d-b0d1-4868-a4ca-ca1976451588 for instance 53705ab2-462b-4198-8565-c1ad2fbf535d on hv-cinder-84779 Jun 27 15:27:18.771694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-27229fba-2e74-49c6-b948-1a14160668ac req-dea32d50-092d-48fc-882a-980fdeeae428 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076076 Jun 27 15:27:18.772740 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 49/100] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:18.944222 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3a2ce5fd-deb0-494f-a69e-4ee054f5f278 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:18.968800 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3a2ce5fd-deb0-494f-a69e-4ee054f5f278 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 0.394617 Jun 27 15:27:18.971969 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 52/101] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:18 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:19.211302 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1fe2b357-f571-42ec-8dee-5226ced64c5e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:19.212113 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-1fe2b357-f571-42ec-8dee-5226ced64c5e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:19.236876 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1fe2b357-f571-42ec-8dee-5226ced64c5e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:19.237366 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1fe2b357-f571-42ec-8dee-5226ced64c5e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:19.238236 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1fe2b357-f571-42ec-8dee-5226ced64c5e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:19.238684 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1fe2b357-f571-42ec-8dee-5226ced64c5e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:19.573908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-06fa00db-f5fb-46bd-92e2-e2d33f86eed8 req-cc572aa2-113a-4d5d-a3d2-7fbd7929a468 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a", "name": "network-vif-plugged", "status": "completed", "tag": "05ebe349-4d00-4c7d-9c0d-a92627d5285d"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:19.598872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-06fa00db-f5fb-46bd-92e2-e2d33f86eed8 req-cc572aa2-113a-4d5d-a3d2-7fbd7929a468 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:19.599314 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-06fa00db-f5fb-46bd-92e2-e2d33f86eed8 req-cc572aa2-113a-4d5d-a3d2-7fbd7929a468 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:19.620151 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-06fa00db-f5fb-46bd-92e2-e2d33f86eed8 req-cc572aa2-113a-4d5d-a3d2-7fbd7929a468 service nova] Creating event network-vif-plugged:05ebe349-4d00-4c7d-9c0d-a92627d5285d for instance c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a on hv-cinder-84779 Jun 27 15:27:19.638680 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-06fa00db-f5fb-46bd-92e2-e2d33f86eed8 req-cc572aa2-113a-4d5d-a3d2-7fbd7929a468 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.198190 Jun 27 15:27:19.639532 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 53/102] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:19.651833 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-805ddd42-8b8f-49cf-9065-5846cd94f4a0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:19.657584 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-805ddd42-8b8f-49cf-9065-5846cd94f4a0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:19.670476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-805ddd42-8b8f-49cf-9065-5846cd94f4a0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:19.670917 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-805ddd42-8b8f-49cf-9065-5846cd94f4a0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:19.671730 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-805ddd42-8b8f-49cf-9065-5846cd94f4a0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:19.672157 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-805ddd42-8b8f-49cf-9065-5846cd94f4a0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:19.983417 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-805ddd42-8b8f-49cf-9065-5846cd94f4a0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:20.034147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-805ddd42-8b8f-49cf-9065-5846cd94f4a0 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 0.380529 Jun 27 15:27:20.038689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 54/103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:19 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:20.060557 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2608b705-ef8a-43f1-bece-cf6c707fabde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:20.062504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2608b705-ef8a-43f1-bece-cf6c707fabde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:20.079846 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2608b705-ef8a-43f1-bece-cf6c707fabde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:20.081074 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2608b705-ef8a-43f1-bece-cf6c707fabde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:20.082474 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2608b705-ef8a-43f1-bece-cf6c707fabde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:20.083111 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2608b705-ef8a-43f1-bece-cf6c707fabde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:20.398543 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1fe2b357-f571-42ec-8dee-5226ced64c5e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:20.413243 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-1fe2b357-f571-42ec-8dee-5226ced64c5e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 1.206653 Jun 27 15:27:20.418995 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 50/104] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:19 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 1214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:20.431256 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-cb7fe27c-bcf0-47b3-97af-906d3016ab2c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:20.433312 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-cb7fe27c-bcf0-47b3-97af-906d3016ab2c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:20.451037 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cb7fe27c-bcf0-47b3-97af-906d3016ab2c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:20.454872 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cb7fe27c-bcf0-47b3-97af-906d3016ab2c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:20.456493 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cb7fe27c-bcf0-47b3-97af-906d3016ab2c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:20.457481 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cb7fe27c-bcf0-47b3-97af-906d3016ab2c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:20.592429 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2608b705-ef8a-43f1-bece-cf6c707fabde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:20.623438 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2608b705-ef8a-43f1-bece-cf6c707fabde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:20.626504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2608b705-ef8a-43f1-bece-cf6c707fabde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:20.636892 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2608b705-ef8a-43f1-bece-cf6c707fabde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.586759 Jun 27 15:27:20.660361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 55/105] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:20 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:21.076025 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b552dc50-8df2-413f-aebf-8a75c08799e9 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:21.080628 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b552dc50-8df2-413f-aebf-8a75c08799e9 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:21.106279 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b552dc50-8df2-413f-aebf-8a75c08799e9 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:21.107622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b552dc50-8df2-413f-aebf-8a75c08799e9 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:21.109623 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-cb7fe27c-bcf0-47b3-97af-906d3016ab2c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:21.109813 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b552dc50-8df2-413f-aebf-8a75c08799e9 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:21.110944 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b552dc50-8df2-413f-aebf-8a75c08799e9 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:21.118385 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-cb7fe27c-bcf0-47b3-97af-906d3016ab2c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 0.697753 Jun 27 15:27:21.122184 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 51/106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:20 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:21.446325 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a7336f8a-8435-4c1b-b616-9d9d0f8fa5c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:21.447374 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a7336f8a-8435-4c1b-b616-9d9d0f8fa5c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:21.460582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a7336f8a-8435-4c1b-b616-9d9d0f8fa5c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:21.461035 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a7336f8a-8435-4c1b-b616-9d9d0f8fa5c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:21.462048 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a7336f8a-8435-4c1b-b616-9d9d0f8fa5c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:21.462659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a7336f8a-8435-4c1b-b616-9d9d0f8fa5c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:21.478332 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b552dc50-8df2-413f-aebf-8a75c08799e9 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:21.491443 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b552dc50-8df2-413f-aebf-8a75c08799e9 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 0.438373 Jun 27 15:27:21.509869 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 56/107] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:21 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:21.682179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-d8eddf18-d8f1-4995-9c3b-8b7bf38c6397 req-14beb541-3f6e-447e-b227-b372401acd43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa7f3fe-5f45-46ca-960d-1c77079dceb6", "name": "network-vif-plugged", "status": "completed", "tag": "6589e017-7d15-4438-86e5-e3a74e6999a7"}, {"server_uuid": "05ad818a-43eb-47d0-a466-eeeec96fd758", "name": "network-vif-plugged", "status": "completed", "tag": "d3ed4003-b3bf-4b78-872f-0deb501c8889"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:21.701904 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d8eddf18-d8f1-4995-9c3b-8b7bf38c6397 req-14beb541-3f6e-447e-b227-b372401acd43 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:21.702817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d8eddf18-d8f1-4995-9c3b-8b7bf38c6397 req-14beb541-3f6e-447e-b227-b372401acd43 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:21.720245 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-d8eddf18-d8f1-4995-9c3b-8b7bf38c6397 req-14beb541-3f6e-447e-b227-b372401acd43 service nova] Creating event network-vif-plugged:6589e017-7d15-4438-86e5-e3a74e6999a7 for instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 on hv-cinder-84779 Jun 27 15:27:21.721712 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-d8eddf18-d8f1-4995-9c3b-8b7bf38c6397 req-14beb541-3f6e-447e-b227-b372401acd43 service nova] Creating event network-vif-plugged:d3ed4003-b3bf-4b78-872f-0deb501c8889 for instance 05ad818a-43eb-47d0-a466-eeeec96fd758 on hv-cinder-84779 Jun 27 15:27:21.731761 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-d8eddf18-d8f1-4995-9c3b-8b7bf38c6397 req-14beb541-3f6e-447e-b227-b372401acd43 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.061530 Jun 27 15:27:21.733621 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 57/108] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:27:21.742088 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-04612527-1991-4b87-9a8e-32a8b9447595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:21.744107 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-04612527-1991-4b87-9a8e-32a8b9447595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:21.806946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-04612527-1991-4b87-9a8e-32a8b9447595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:21.810812 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-04612527-1991-4b87-9a8e-32a8b9447595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:21.812346 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-04612527-1991-4b87-9a8e-32a8b9447595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:21.813206 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-04612527-1991-4b87-9a8e-32a8b9447595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:22.119172 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-04612527-1991-4b87-9a8e-32a8b9447595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:22.171019 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-04612527-1991-4b87-9a8e-32a8b9447595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:22.181593 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-04612527-1991-4b87-9a8e-32a8b9447595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:22.188390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-04612527-1991-4b87-9a8e-32a8b9447595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.452520 Jun 27 15:27:22.194577 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 58/109] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:21 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:22.245387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a7336f8a-8435-4c1b-b616-9d9d0f8fa5c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:22.251599 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4a278542-c5b3-4b8a-9778-e331b5fdaccd tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:22.255345 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4a278542-c5b3-4b8a-9778-e331b5fdaccd tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:22.277165 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a278542-c5b3-4b8a-9778-e331b5fdaccd tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:22.281895 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a278542-c5b3-4b8a-9778-e331b5fdaccd tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:22.284020 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a278542-c5b3-4b8a-9778-e331b5fdaccd tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:22.284843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a278542-c5b3-4b8a-9778-e331b5fdaccd tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:22.306808 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a7336f8a-8435-4c1b-b616-9d9d0f8fa5c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.857610 Jun 27 15:27:22.307627 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 52/110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:21 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 866 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:22.524051 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7eb798e9-fd7e-41bf-9bf0-372e95421907 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:22.531528 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7eb798e9-fd7e-41bf-9bf0-372e95421907 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:22.557028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7eb798e9-fd7e-41bf-9bf0-372e95421907 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:22.565432 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7eb798e9-fd7e-41bf-9bf0-372e95421907 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:22.566973 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7eb798e9-fd7e-41bf-9bf0-372e95421907 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:22.567824 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7eb798e9-fd7e-41bf-9bf0-372e95421907 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:22.607655 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4a278542-c5b3-4b8a-9778-e331b5fdaccd tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:22.630238 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4a278542-c5b3-4b8a-9778-e331b5fdaccd tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1322 microversion: 2.1 time: 0.426547 Jun 27 15:27:22.631257 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 59/111] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:22 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1322 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:22.810549 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7eb798e9-fd7e-41bf-9bf0-372e95421907 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:22.819849 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7eb798e9-fd7e-41bf-9bf0-372e95421907 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 0.305185 Jun 27 15:27:22.820464 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 53/112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:22 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:23.226189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-99697531-021e-4b8c-847b-8dff3818cff8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:23.232556 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-99697531-021e-4b8c-847b-8dff3818cff8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:23.292901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99697531-021e-4b8c-847b-8dff3818cff8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:23.298146 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99697531-021e-4b8c-847b-8dff3818cff8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:23.302549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99697531-021e-4b8c-847b-8dff3818cff8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:23.306231 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99697531-021e-4b8c-847b-8dff3818cff8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:23.339237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-76768d10-f883-47aa-83b3-d139d8aff96e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:23.341184 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-76768d10-f883-47aa-83b3-d139d8aff96e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:23.376717 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76768d10-f883-47aa-83b3-d139d8aff96e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:23.383735 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76768d10-f883-47aa-83b3-d139d8aff96e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:23.390572 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76768d10-f883-47aa-83b3-d139d8aff96e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:23.391201 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76768d10-f883-47aa-83b3-d139d8aff96e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:23.469452 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=100 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:23.713947 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-76768d10-f883-47aa-83b3-d139d8aff96e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:23.731665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-76768d10-f883-47aa-83b3-d139d8aff96e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.396706 Jun 27 15:27:23.748366 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-99697531-021e-4b8c-847b-8dff3818cff8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:23.749043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 54/113] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:23 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:23.749043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-46e672b7-3fc4-46f4-b8fa-159b922a67ca tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:23.749043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-46e672b7-3fc4-46f4-b8fa-159b922a67ca tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:23.753611 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-99697531-021e-4b8c-847b-8dff3818cff8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:23.753611 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-99697531-021e-4b8c-847b-8dff3818cff8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:23.754484 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-99697531-021e-4b8c-847b-8dff3818cff8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.537166 Jun 27 15:27:23.755113 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 60/114] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:23 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:23.775479 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-46e672b7-3fc4-46f4-b8fa-159b922a67ca tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:23.776491 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-46e672b7-3fc4-46f4-b8fa-159b922a67ca tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:23.778508 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-46e672b7-3fc4-46f4-b8fa-159b922a67ca tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:23.779343 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-46e672b7-3fc4-46f4-b8fa-159b922a67ca tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:23.842257 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-805f5598-1a6f-4345-9e2a-bd8fd45bd0ce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:23.849939 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-805f5598-1a6f-4345-9e2a-bd8fd45bd0ce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:23.860702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-805f5598-1a6f-4345-9e2a-bd8fd45bd0ce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:23.862347 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-805f5598-1a6f-4345-9e2a-bd8fd45bd0ce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:23.863884 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-805f5598-1a6f-4345-9e2a-bd8fd45bd0ce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:23.864616 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-805f5598-1a6f-4345-9e2a-bd8fd45bd0ce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:24.049855 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-46e672b7-3fc4-46f4-b8fa-159b922a67ca tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:24.067869 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-46e672b7-3fc4-46f4-b8fa-159b922a67ca tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1515 microversion: 2.1 time: 0.332690 Jun 27 15:27:24.069379 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 55/115] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:23 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1515 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:24.088545 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-18b4dc6e-4126-4655-ad1e-ed9b903f1d49 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:24.090004 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-18b4dc6e-4126-4655-ad1e-ed9b903f1d49 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:24.099022 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18b4dc6e-4126-4655-ad1e-ed9b903f1d49 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:24.100237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18b4dc6e-4126-4655-ad1e-ed9b903f1d49 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:24.102192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18b4dc6e-4126-4655-ad1e-ed9b903f1d49 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:24.102947 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18b4dc6e-4126-4655-ad1e-ed9b903f1d49 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:24.138973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-805f5598-1a6f-4345-9e2a-bd8fd45bd0ce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:24.153618 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-805f5598-1a6f-4345-9e2a-bd8fd45bd0ce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 0.318759 Jun 27 15:27:24.154659 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 61/116] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:23 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:24.228844 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-18b4dc6e-4126-4655-ad1e-ed9b903f1d49 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lazy-loading 'flavor' on Instance uuid c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:27:24.373789 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-18b4dc6e-4126-4655-ad1e-ed9b903f1d49 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a/action" status: 200 len: 32 microversion: 2.1 time: 0.291205 Jun 27 15:27:24.374964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 56/117] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:27:24 2022] POST /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a/action => generated 32 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:27:24.391709 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f621abd1-3798-420e-9328-2f038c372db8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:24.392866 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f621abd1-3798-420e-9328-2f038c372db8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:24.404101 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f621abd1-3798-420e-9328-2f038c372db8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:24.405803 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f621abd1-3798-420e-9328-2f038c372db8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:24.408060 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f621abd1-3798-420e-9328-2f038c372db8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:24.409750 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f621abd1-3798-420e-9328-2f038c372db8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:24.680435 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f621abd1-3798-420e-9328-2f038c372db8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:24.691621 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f621abd1-3798-420e-9328-2f038c372db8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.308239 Jun 27 15:27:24.692526 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 62/118] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:24 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:24.761364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7010bec5-fef5-4358-b5d0-9fd5d19bee17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:24.762142 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7010bec5-fef5-4358-b5d0-9fd5d19bee17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:24.792783 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7010bec5-fef5-4358-b5d0-9fd5d19bee17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:24.795757 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7010bec5-fef5-4358-b5d0-9fd5d19bee17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:24.797856 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7010bec5-fef5-4358-b5d0-9fd5d19bee17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:24.799659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7010bec5-fef5-4358-b5d0-9fd5d19bee17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:24.801198 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4d9ea89c-051c-4526-9418-5216f5a0cafb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:24.802121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4d9ea89c-051c-4526-9418-5216f5a0cafb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:24.817217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d9ea89c-051c-4526-9418-5216f5a0cafb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:24.818551 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d9ea89c-051c-4526-9418-5216f5a0cafb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:24.820387 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d9ea89c-051c-4526-9418-5216f5a0cafb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:24.821698 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d9ea89c-051c-4526-9418-5216f5a0cafb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:25.042683 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7010bec5-fef5-4358-b5d0-9fd5d19bee17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:25.052019 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7010bec5-fef5-4358-b5d0-9fd5d19bee17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.295142 Jun 27 15:27:25.058492 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 57/119] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:24 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:25.175346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a8d030f5-fb31-4471-99d4-f9ba5131f59a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:25.177346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a8d030f5-fb31-4471-99d4-f9ba5131f59a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:25.191495 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8d030f5-fb31-4471-99d4-f9ba5131f59a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:25.194928 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8d030f5-fb31-4471-99d4-f9ba5131f59a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:25.201820 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8d030f5-fb31-4471-99d4-f9ba5131f59a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:25.202824 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8d030f5-fb31-4471-99d4-f9ba5131f59a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:25.331082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4d9ea89c-051c-4526-9418-5216f5a0cafb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:25.354608 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4d9ea89c-051c-4526-9418-5216f5a0cafb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:25.358575 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4d9ea89c-051c-4526-9418-5216f5a0cafb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:25.361530 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4d9ea89c-051c-4526-9418-5216f5a0cafb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.575101 Jun 27 15:27:25.363019 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 63/120] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:24 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:25.669189 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a8d030f5-fb31-4471-99d4-f9ba5131f59a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:25.682835 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a8d030f5-fb31-4471-99d4-f9ba5131f59a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1315 microversion: 2.1 time: 0.514349 Jun 27 15:27:25.687370 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 58/121] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:25 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1315 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:25.718416 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d48cc13b-93ee-4ce2-b303-638ad7dbb843 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:25.719964 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d48cc13b-93ee-4ce2-b303-638ad7dbb843 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:25.729804 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d48cc13b-93ee-4ce2-b303-638ad7dbb843 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:25.730507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d48cc13b-93ee-4ce2-b303-638ad7dbb843 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:25.731530 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d48cc13b-93ee-4ce2-b303-638ad7dbb843 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:25.732135 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d48cc13b-93ee-4ce2-b303-638ad7dbb843 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:26.090327 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e90bb9e4-e002-4403-8fbb-c20e01201d2b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:26.091143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e90bb9e4-e002-4403-8fbb-c20e01201d2b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:26.094743 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:26.104807 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e90bb9e4-e002-4403-8fbb-c20e01201d2b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:26.105401 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e90bb9e4-e002-4403-8fbb-c20e01201d2b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:26.106477 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e90bb9e4-e002-4403-8fbb-c20e01201d2b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:26.107075 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e90bb9e4-e002-4403-8fbb-c20e01201d2b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:26.114476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d48cc13b-93ee-4ce2-b303-638ad7dbb843 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:26.129485 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d48cc13b-93ee-4ce2-b303-638ad7dbb843 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.415872 Jun 27 15:27:26.130500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 64/122] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:25 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:26.317859 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e90bb9e4-e002-4403-8fbb-c20e01201d2b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:26.325493 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e90bb9e4-e002-4403-8fbb-c20e01201d2b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.239172 Jun 27 15:27:26.328917 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 59/123] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:26 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:26.381846 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5eb6cb6a-8362-42d3-9b22-c224d4393ec5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:26.382799 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5eb6cb6a-8362-42d3-9b22-c224d4393ec5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:26.389700 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5eb6cb6a-8362-42d3-9b22-c224d4393ec5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:26.390294 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5eb6cb6a-8362-42d3-9b22-c224d4393ec5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:26.391184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5eb6cb6a-8362-42d3-9b22-c224d4393ec5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:26.391743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5eb6cb6a-8362-42d3-9b22-c224d4393ec5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:26.613335 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5eb6cb6a-8362-42d3-9b22-c224d4393ec5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:26.624226 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5eb6cb6a-8362-42d3-9b22-c224d4393ec5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:26.625866 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5eb6cb6a-8362-42d3-9b22-c224d4393ec5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:26.627082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5eb6cb6a-8362-42d3-9b22-c224d4393ec5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.249935 Jun 27 15:27:26.627660 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 65/124] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:26 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:27:26.713839 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ec8132f8-c6ca-47a5-96b3-326885c08a5c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:26.714547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ec8132f8-c6ca-47a5-96b3-326885c08a5c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:26.724003 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ec8132f8-c6ca-47a5-96b3-326885c08a5c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:26.725901 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ec8132f8-c6ca-47a5-96b3-326885c08a5c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:26.727885 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ec8132f8-c6ca-47a5-96b3-326885c08a5c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:26.728716 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ec8132f8-c6ca-47a5-96b3-326885c08a5c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:26.932563 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ec8132f8-c6ca-47a5-96b3-326885c08a5c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:26.965986 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ec8132f8-c6ca-47a5-96b3-326885c08a5c tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1502 microversion: 2.1 time: 0.256458 Jun 27 15:27:26.969009 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 60/125] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:26 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1502 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:26.972904 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-d90df3d8-cd7d-419e-ace3-f9e219556eda req-261b51ce-2090-4249-81ae-f835336489e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53705ab2-462b-4198-8565-c1ad2fbf535d", "name": "network-vif-plugged", "status": "completed", "tag": "309f419d-b0d1-4868-a4ca-ca1976451588"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:27.001252 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:27.016255 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d90df3d8-cd7d-419e-ace3-f9e219556eda req-261b51ce-2090-4249-81ae-f835336489e1 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:27.016781 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d90df3d8-cd7d-419e-ace3-f9e219556eda req-261b51ce-2090-4249-81ae-f835336489e1 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:27.063093 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-d90df3d8-cd7d-419e-ace3-f9e219556eda req-261b51ce-2090-4249-81ae-f835336489e1 service nova] Creating event network-vif-plugged:309f419d-b0d1-4868-a4ca-ca1976451588 for instance 53705ab2-462b-4198-8565-c1ad2fbf535d on hv-cinder-84779 Jun 27 15:27:27.086052 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-d90df3d8-cd7d-419e-ace3-f9e219556eda req-261b51ce-2090-4249-81ae-f835336489e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.122143 Jun 27 15:27:27.086675 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 66/126] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:27.151919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-52c5ca3f-e50f-460c-b907-600a4071ffba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:27.152954 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-52c5ca3f-e50f-460c-b907-600a4071ffba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:27.170831 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-52c5ca3f-e50f-460c-b907-600a4071ffba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:27.170831 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-52c5ca3f-e50f-460c-b907-600a4071ffba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:27.170831 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-52c5ca3f-e50f-460c-b907-600a4071ffba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:27.170831 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-52c5ca3f-e50f-460c-b907-600a4071ffba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:27.345495 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fc7dba2a-adb5-418e-8368-79dee0e6a6bf tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:27.346111 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fc7dba2a-adb5-418e-8368-79dee0e6a6bf tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:27.364751 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc7dba2a-adb5-418e-8368-79dee0e6a6bf tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:27.365207 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc7dba2a-adb5-418e-8368-79dee0e6a6bf tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:27.366010 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc7dba2a-adb5-418e-8368-79dee0e6a6bf tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:27.366446 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc7dba2a-adb5-418e-8368-79dee0e6a6bf tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:27.810245 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-52c5ca3f-e50f-460c-b907-600a4071ffba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:27.826538 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-52c5ca3f-e50f-460c-b907-600a4071ffba tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.678786 Jun 27 15:27:27.827874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 61/127] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:27 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:27.837071 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fc7dba2a-adb5-418e-8368-79dee0e6a6bf tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:27.838089 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-deb0806f-3702-4480-89cf-8dfa2b8df630 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:27.839812 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-deb0806f-3702-4480-89cf-8dfa2b8df630 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:27.852160 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-deb0806f-3702-4480-89cf-8dfa2b8df630 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:27.853062 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-deb0806f-3702-4480-89cf-8dfa2b8df630 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:27.854340 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fc7dba2a-adb5-418e-8368-79dee0e6a6bf tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.514850 Jun 27 15:27:27.854584 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-deb0806f-3702-4480-89cf-8dfa2b8df630 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:27.854932 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 67/128] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:27 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:27.855483 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-deb0806f-3702-4480-89cf-8dfa2b8df630 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:28.121439 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-deb0806f-3702-4480-89cf-8dfa2b8df630 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:28.133182 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-deb0806f-3702-4480-89cf-8dfa2b8df630 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:28.136118 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-deb0806f-3702-4480-89cf-8dfa2b8df630 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:28.138046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-deb0806f-3702-4480-89cf-8dfa2b8df630 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.308357 Jun 27 15:27:28.138924 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 62/129] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:27 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:28.844528 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9fe42e31-72da-48ec-bc5a-957348621527 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:28.845150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9fe42e31-72da-48ec-bc5a-957348621527 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:28.852541 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fe42e31-72da-48ec-bc5a-957348621527 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:28.852866 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fe42e31-72da-48ec-bc5a-957348621527 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:28.853643 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fe42e31-72da-48ec-bc5a-957348621527 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:28.854118 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fe42e31-72da-48ec-bc5a-957348621527 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:28.874711 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8e8d6361-3d5e-48c4-8bcc-6132ffadb8ab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:28.877999 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8e8d6361-3d5e-48c4-8bcc-6132ffadb8ab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:28.888258 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8e8d6361-3d5e-48c4-8bcc-6132ffadb8ab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:28.888748 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8e8d6361-3d5e-48c4-8bcc-6132ffadb8ab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:28.889520 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8e8d6361-3d5e-48c4-8bcc-6132ffadb8ab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:28.889945 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8e8d6361-3d5e-48c4-8bcc-6132ffadb8ab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:29.032511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9fe42e31-72da-48ec-bc5a-957348621527 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:29.041071 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9fe42e31-72da-48ec-bc5a-957348621527 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.200478 Jun 27 15:27:29.041692 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 68/130] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:28 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:29.086961 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-8e8d6361-3d5e-48c4-8bcc-6132ffadb8ab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:29.096425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8e8d6361-3d5e-48c4-8bcc-6132ffadb8ab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.227272 Jun 27 15:27:29.097203 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 63/131] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:28 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:29.161225 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-08ce806d-5ad6-45c6-8a26-c8b304675144 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:29.162366 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-08ce806d-5ad6-45c6-8a26-c8b304675144 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:29.171194 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08ce806d-5ad6-45c6-8a26-c8b304675144 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:29.171640 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08ce806d-5ad6-45c6-8a26-c8b304675144 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:29.172574 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08ce806d-5ad6-45c6-8a26-c8b304675144 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:29.172894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-08ce806d-5ad6-45c6-8a26-c8b304675144 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:29.372206 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-08ce806d-5ad6-45c6-8a26-c8b304675144 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:29.386561 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-08ce806d-5ad6-45c6-8a26-c8b304675144 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:29.390534 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-08ce806d-5ad6-45c6-8a26-c8b304675144 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:29.392239 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-08ce806d-5ad6-45c6-8a26-c8b304675144 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.238824 Jun 27 15:27:29.393422 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 69/132] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:29 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:30.067334 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2f28156a-b2fa-49d0-9602-dd46c0bba94b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:30.068136 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2f28156a-b2fa-49d0-9602-dd46c0bba94b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:30.075291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2f28156a-b2fa-49d0-9602-dd46c0bba94b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:30.075746 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2f28156a-b2fa-49d0-9602-dd46c0bba94b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:30.076579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2f28156a-b2fa-49d0-9602-dd46c0bba94b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:30.077021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2f28156a-b2fa-49d0-9602-dd46c0bba94b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:30.114422 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-96b3fb73-5825-47ff-a1a7-fb83900f2b1b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:30.115088 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-96b3fb73-5825-47ff-a1a7-fb83900f2b1b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:30.121779 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96b3fb73-5825-47ff-a1a7-fb83900f2b1b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:30.122194 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96b3fb73-5825-47ff-a1a7-fb83900f2b1b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:30.123019 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96b3fb73-5825-47ff-a1a7-fb83900f2b1b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:30.123455 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-96b3fb73-5825-47ff-a1a7-fb83900f2b1b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:30.141548 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:30.233079 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2f28156a-b2fa-49d0-9602-dd46c0bba94b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:30.247333 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2f28156a-b2fa-49d0-9602-dd46c0bba94b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.184185 Jun 27 15:27:30.248635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 64/133] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:30 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:30.304590 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-96b3fb73-5825-47ff-a1a7-fb83900f2b1b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:30.313494 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-96b3fb73-5825-47ff-a1a7-fb83900f2b1b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.203389 Jun 27 15:27:30.314098 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 70/134] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:30 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:30.417159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-780ea83e-3456-4ae0-a23f-2be819eb3666 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:30.418044 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-780ea83e-3456-4ae0-a23f-2be819eb3666 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:30.425560 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-780ea83e-3456-4ae0-a23f-2be819eb3666 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:30.426097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-780ea83e-3456-4ae0-a23f-2be819eb3666 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:30.426941 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-780ea83e-3456-4ae0-a23f-2be819eb3666 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:30.427468 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-780ea83e-3456-4ae0-a23f-2be819eb3666 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:30.604362 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-780ea83e-3456-4ae0-a23f-2be819eb3666 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:30.614997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-780ea83e-3456-4ae0-a23f-2be819eb3666 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:30.615174 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-780ea83e-3456-4ae0-a23f-2be819eb3666 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:30.616200 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-780ea83e-3456-4ae0-a23f-2be819eb3666 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.203526 Jun 27 15:27:30.616799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 65/135] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:30 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:30.950936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f836e0cc-68d6-43b2-8add-ccbcd5002bce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4419f661-d8b1-47f4-9a25-d9ede770deaa"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:30.952539 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f836e0cc-68d6-43b2-8add-ccbcd5002bce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:30.959449 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f836e0cc-68d6-43b2-8add-ccbcd5002bce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:30.960299 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f836e0cc-68d6-43b2-8add-ccbcd5002bce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:30.961449 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f836e0cc-68d6-43b2-8add-ccbcd5002bce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:30.961449 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f836e0cc-68d6-43b2-8add-ccbcd5002bce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:31.265559 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f5ea111b-4772-4f1e-a7cf-135c967231ac tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:31.266191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f5ea111b-4772-4f1e-a7cf-135c967231ac tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:31.273116 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f5ea111b-4772-4f1e-a7cf-135c967231ac tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:31.273560 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f5ea111b-4772-4f1e-a7cf-135c967231ac tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:31.274321 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f5ea111b-4772-4f1e-a7cf-135c967231ac tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:31.274762 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f5ea111b-4772-4f1e-a7cf-135c967231ac tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:31.447554 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f5ea111b-4772-4f1e-a7cf-135c967231ac tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:31.457917 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f5ea111b-4772-4f1e-a7cf-135c967231ac tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.196124 Jun 27 15:27:31.458517 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 66/136] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:31 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:31.463945 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-455afeb8-f80b-4035-8bb7-74ff42d25bab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:31.464919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-455afeb8-f80b-4035-8bb7-74ff42d25bab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:31.472494 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-455afeb8-f80b-4035-8bb7-74ff42d25bab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:31.473236 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-455afeb8-f80b-4035-8bb7-74ff42d25bab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:31.474181 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-455afeb8-f80b-4035-8bb7-74ff42d25bab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:31.474777 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-455afeb8-f80b-4035-8bb7-74ff42d25bab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:31.640255 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f836e0cc-68d6-43b2-8add-ccbcd5002bce tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "POST /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.693649 Jun 27 15:27:31.642696 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 71/137] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:27:30 2022] POST /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758/os-volume_attachments => generated 194 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:31.659308 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-55962c05-c77f-424f-b17e-4aadf469f756 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:31.661733 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-55962c05-c77f-424f-b17e-4aadf469f756 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:31.676800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-455afeb8-f80b-4035-8bb7-74ff42d25bab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:31.678179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-55962c05-c77f-424f-b17e-4aadf469f756 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:31.679118 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-55962c05-c77f-424f-b17e-4aadf469f756 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:31.680355 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-55962c05-c77f-424f-b17e-4aadf469f756 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:31.681194 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-55962c05-c77f-424f-b17e-4aadf469f756 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:31.690563 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-455afeb8-f80b-4035-8bb7-74ff42d25bab tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1361 microversion: 2.1 time: 0.230640 Jun 27 15:27:31.691200 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 67/138] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:31 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1361 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:31.910952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-55962c05-c77f-424f-b17e-4aadf469f756 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:31.930414 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-55962c05-c77f-424f-b17e-4aadf469f756 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:31.934019 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-55962c05-c77f-424f-b17e-4aadf469f756 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:31.935779 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-55962c05-c77f-424f-b17e-4aadf469f756 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.291599 Jun 27 15:27:31.936563 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 72/139] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:31 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:32.488117 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7cbd8fd7-547e-49fd-971e-d247f8d4f3e6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:32.488850 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7cbd8fd7-547e-49fd-971e-d247f8d4f3e6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:32.498283 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7cbd8fd7-547e-49fd-971e-d247f8d4f3e6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:32.498932 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7cbd8fd7-547e-49fd-971e-d247f8d4f3e6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:32.500353 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7cbd8fd7-547e-49fd-971e-d247f8d4f3e6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:32.501038 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7cbd8fd7-547e-49fd-971e-d247f8d4f3e6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:32.666457 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7cbd8fd7-547e-49fd-971e-d247f8d4f3e6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:32.675895 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7cbd8fd7-547e-49fd-971e-d247f8d4f3e6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.195870 Jun 27 15:27:32.676501 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 68/140] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:32 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:32.708638 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6922ee8f-c15a-46c1-8f35-ad013a2047c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:32.709251 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6922ee8f-c15a-46c1-8f35-ad013a2047c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:32.717359 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6922ee8f-c15a-46c1-8f35-ad013a2047c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:32.717809 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6922ee8f-c15a-46c1-8f35-ad013a2047c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:32.718631 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6922ee8f-c15a-46c1-8f35-ad013a2047c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:32.719335 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6922ee8f-c15a-46c1-8f35-ad013a2047c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:32.903277 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6922ee8f-c15a-46c1-8f35-ad013a2047c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:32.911805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6922ee8f-c15a-46c1-8f35-ad013a2047c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1546 microversion: 2.1 time: 0.207969 Jun 27 15:27:32.912420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 73/141] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:32 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1546 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:32.936288 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-77fc8a91-153b-4d36-9b58-2d6a266a0ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:32.936819 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-77fc8a91-153b-4d36-9b58-2d6a266a0ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:32.943436 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77fc8a91-153b-4d36-9b58-2d6a266a0ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:32.944065 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77fc8a91-153b-4d36-9b58-2d6a266a0ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:32.944725 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77fc8a91-153b-4d36-9b58-2d6a266a0ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:32.945149 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77fc8a91-153b-4d36-9b58-2d6a266a0ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:32.947926 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:32.955568 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cdd30bc1-5b9c-4f78-bf20-409f61b0625d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:32.956184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cdd30bc1-5b9c-4f78-bf20-409f61b0625d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:32.968160 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdd30bc1-5b9c-4f78-bf20-409f61b0625d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:32.968657 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdd30bc1-5b9c-4f78-bf20-409f61b0625d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:32.969456 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdd30bc1-5b9c-4f78-bf20-409f61b0625d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:32.969884 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdd30bc1-5b9c-4f78-bf20-409f61b0625d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:33.047432 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-77fc8a91-153b-4d36-9b58-2d6a266a0ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116077 Jun 27 15:27:33.047974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 69/142] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jun 27 15:27:32 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/os-interface => generated 284 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:33.119603 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cdd30bc1-5b9c-4f78-bf20-409f61b0625d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:33.131040 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cdd30bc1-5b9c-4f78-bf20-409f61b0625d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:33.133173 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cdd30bc1-5b9c-4f78-bf20-409f61b0625d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:33.134458 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cdd30bc1-5b9c-4f78-bf20-409f61b0625d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.183310 Jun 27 15:27:33.135333 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 74/143] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:32 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:27:33.576832 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-74d5027b-f96f-4aa3-a2b9-78c158924d9f req-b3bf5471-6e3b-42d2-80ab-87fee4bb1715 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831291d0-f04d-4927-afcd-88fd058db642", "name": "network-vif-plugged", "status": "completed", "tag": "62696634-23e0-4313-bcf8-d3be6665d3aa"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:33.590818 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-74d5027b-f96f-4aa3-a2b9-78c158924d9f req-b3bf5471-6e3b-42d2-80ab-87fee4bb1715 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:33.591453 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-74d5027b-f96f-4aa3-a2b9-78c158924d9f req-b3bf5471-6e3b-42d2-80ab-87fee4bb1715 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:33.607357 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-74d5027b-f96f-4aa3-a2b9-78c158924d9f req-b3bf5471-6e3b-42d2-80ab-87fee4bb1715 service nova] Creating event network-vif-plugged:62696634-23e0-4313-bcf8-d3be6665d3aa for instance 831291d0-f04d-4927-afcd-88fd058db642 on hv-cinder-84779 Jun 27 15:27:33.617812 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-74d5027b-f96f-4aa3-a2b9-78c158924d9f req-b3bf5471-6e3b-42d2-80ab-87fee4bb1715 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045912 Jun 27 15:27:33.619471 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 70/144] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:33.700791 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-672450fb-c3ca-440a-9f81-06ad399dacee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:33.701872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-672450fb-c3ca-440a-9f81-06ad399dacee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:33.708604 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-672450fb-c3ca-440a-9f81-06ad399dacee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:33.709051 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-672450fb-c3ca-440a-9f81-06ad399dacee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:33.709823 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-672450fb-c3ca-440a-9f81-06ad399dacee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:33.710261 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-672450fb-c3ca-440a-9f81-06ad399dacee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:33.858063 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-672450fb-c3ca-440a-9f81-06ad399dacee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:33.866109 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-672450fb-c3ca-440a-9f81-06ad399dacee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.175333 Jun 27 15:27:33.867939 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 75/145] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:33 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:34.155276 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fa99ff05-d480-442a-bc23-8908c55cad6e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:34.156177 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-fa99ff05-d480-442a-bc23-8908c55cad6e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:34.166625 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa99ff05-d480-442a-bc23-8908c55cad6e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:34.167149 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa99ff05-d480-442a-bc23-8908c55cad6e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:34.167970 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa99ff05-d480-442a-bc23-8908c55cad6e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:34.168733 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa99ff05-d480-442a-bc23-8908c55cad6e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:34.427512 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fa99ff05-d480-442a-bc23-8908c55cad6e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:34.436663 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fa99ff05-d480-442a-bc23-8908c55cad6e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:34.438453 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fa99ff05-d480-442a-bc23-8908c55cad6e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:34.439801 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fa99ff05-d480-442a-bc23-8908c55cad6e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.289178 Jun 27 15:27:34.440634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 71/146] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:34 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:34.623428 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-675b4f09-e5f8-4848-8ec4-f707d8da90ff req-48340f7c-e91f-405b-995c-d0d163175ead service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "53705ab2-462b-4198-8565-c1ad2fbf535d", "tag": "309f419d-b0d1-4868-a4ca-ca1976451588"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:34.633016 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-675b4f09-e5f8-4848-8ec4-f707d8da90ff req-48340f7c-e91f-405b-995c-d0d163175ead service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:34.633455 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-675b4f09-e5f8-4848-8ec4-f707d8da90ff req-48340f7c-e91f-405b-995c-d0d163175ead service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:34.646184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-675b4f09-e5f8-4848-8ec4-f707d8da90ff req-48340f7c-e91f-405b-995c-d0d163175ead service nova] Creating event network-changed:309f419d-b0d1-4868-a4ca-ca1976451588 for instance 53705ab2-462b-4198-8565-c1ad2fbf535d on hv-cinder-84779 Jun 27 15:27:34.651321 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-675b4f09-e5f8-4848-8ec4-f707d8da90ff req-48340f7c-e91f-405b-995c-d0d163175ead service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031624 Jun 27 15:27:34.651928 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 76/147] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:34.884872 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3bf3f5f9-f561-4d1a-b365-0212dd1380fb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:34.885474 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3bf3f5f9-f561-4d1a-b365-0212dd1380fb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:34.891875 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3bf3f5f9-f561-4d1a-b365-0212dd1380fb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:34.892339 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3bf3f5f9-f561-4d1a-b365-0212dd1380fb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:34.893338 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3bf3f5f9-f561-4d1a-b365-0212dd1380fb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:34.893808 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3bf3f5f9-f561-4d1a-b365-0212dd1380fb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:35.105371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3bf3f5f9-f561-4d1a-b365-0212dd1380fb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:35.115265 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3bf3f5f9-f561-4d1a-b365-0212dd1380fb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.234925 Jun 27 15:27:35.116055 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 72/148] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:34 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:35.463059 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3654b06a-e601-48f5-b8fe-4037d1e67be5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:35.464304 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3654b06a-e601-48f5-b8fe-4037d1e67be5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:35.478088 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3654b06a-e601-48f5-b8fe-4037d1e67be5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:35.478447 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3654b06a-e601-48f5-b8fe-4037d1e67be5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:35.479511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3654b06a-e601-48f5-b8fe-4037d1e67be5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:35.480163 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3654b06a-e601-48f5-b8fe-4037d1e67be5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:35.972029 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3654b06a-e601-48f5-b8fe-4037d1e67be5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:35.981736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3654b06a-e601-48f5-b8fe-4037d1e67be5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:35.983295 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3654b06a-e601-48f5-b8fe-4037d1e67be5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:35.984546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3654b06a-e601-48f5-b8fe-4037d1e67be5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.529788 Jun 27 15:27:35.985221 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 77/149] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:35 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:27:36.143904 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-eeb6d046-1029-4891-877c-73b5b0ce6c67 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:36.144625 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-eeb6d046-1029-4891-877c-73b5b0ce6c67 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:36.152610 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eeb6d046-1029-4891-877c-73b5b0ce6c67 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:36.153072 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eeb6d046-1029-4891-877c-73b5b0ce6c67 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:36.154004 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eeb6d046-1029-4891-877c-73b5b0ce6c67 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:36.154440 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eeb6d046-1029-4891-877c-73b5b0ce6c67 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:36.373068 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-eeb6d046-1029-4891-877c-73b5b0ce6c67 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:36.382183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-eeb6d046-1029-4891-877c-73b5b0ce6c67 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.243989 Jun 27 15:27:36.391780 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 73/150] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:36 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:37.005414 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-00b29be5-d1d8-4b22-b203-2639a0721bcf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:37.007044 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-00b29be5-d1d8-4b22-b203-2639a0721bcf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:37.016986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00b29be5-d1d8-4b22-b203-2639a0721bcf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:37.018153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00b29be5-d1d8-4b22-b203-2639a0721bcf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:37.019245 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00b29be5-d1d8-4b22-b203-2639a0721bcf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:37.019986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-00b29be5-d1d8-4b22-b203-2639a0721bcf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:37.247331 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-00b29be5-d1d8-4b22-b203-2639a0721bcf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:37.258209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-00b29be5-d1d8-4b22-b203-2639a0721bcf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:37.260361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-00b29be5-d1d8-4b22-b203-2639a0721bcf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:37.261727 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-00b29be5-d1d8-4b22-b203-2639a0721bcf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.262425 Jun 27 15:27:37.262611 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 78/151] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:36 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:37.399488 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9e09aafe-8f5e-4f7f-af9e-315dd807d4ee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:37.400945 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9e09aafe-8f5e-4f7f-af9e-315dd807d4ee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:37.407822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9e09aafe-8f5e-4f7f-af9e-315dd807d4ee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:37.408982 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9e09aafe-8f5e-4f7f-af9e-315dd807d4ee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:37.410003 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9e09aafe-8f5e-4f7f-af9e-315dd807d4ee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:37.410648 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9e09aafe-8f5e-4f7f-af9e-315dd807d4ee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:37.608263 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9e09aafe-8f5e-4f7f-af9e-315dd807d4ee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:37.617116 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9e09aafe-8f5e-4f7f-af9e-315dd807d4ee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.221649 Jun 27 15:27:37.617709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 74/152] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:37 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:38.288671 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f9fae6c1-ebd1-45ab-8d9c-8008bdd7cde1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:38.288671 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f9fae6c1-ebd1-45ab-8d9c-8008bdd7cde1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:38.291143 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9fae6c1-ebd1-45ab-8d9c-8008bdd7cde1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:38.291835 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9fae6c1-ebd1-45ab-8d9c-8008bdd7cde1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:38.293142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9fae6c1-ebd1-45ab-8d9c-8008bdd7cde1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:38.293876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9fae6c1-ebd1-45ab-8d9c-8008bdd7cde1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:38.460158 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f9fae6c1-ebd1-45ab-8d9c-8008bdd7cde1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:38.465257 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f9fae6c1-ebd1-45ab-8d9c-8008bdd7cde1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:38.466827 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f9fae6c1-ebd1-45ab-8d9c-8008bdd7cde1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:38.468072 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f9fae6c1-ebd1-45ab-8d9c-8008bdd7cde1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.189776 Jun 27 15:27:38.469139 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 79/153] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:38 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:27:38.634250 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7e66b324-724c-45c0-888d-3b2aa9e07124 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:38.634881 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7e66b324-724c-45c0-888d-3b2aa9e07124 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:38.641135 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e66b324-724c-45c0-888d-3b2aa9e07124 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:38.641598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e66b324-724c-45c0-888d-3b2aa9e07124 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:38.642388 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e66b324-724c-45c0-888d-3b2aa9e07124 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:38.642879 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e66b324-724c-45c0-888d-3b2aa9e07124 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:38.805372 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7e66b324-724c-45c0-888d-3b2aa9e07124 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:38.814086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7e66b324-724c-45c0-888d-3b2aa9e07124 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.183756 Jun 27 15:27:38.814830 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 75/154] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:38 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:39.490769 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ca6d6f00-27ab-42ec-9785-b1d84567cf63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:39.491546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ca6d6f00-27ab-42ec-9785-b1d84567cf63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:39.498510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ca6d6f00-27ab-42ec-9785-b1d84567cf63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:39.499398 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ca6d6f00-27ab-42ec-9785-b1d84567cf63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:39.500236 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ca6d6f00-27ab-42ec-9785-b1d84567cf63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:39.500716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ca6d6f00-27ab-42ec-9785-b1d84567cf63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:39.649114 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ca6d6f00-27ab-42ec-9785-b1d84567cf63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:39.662145 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ca6d6f00-27ab-42ec-9785-b1d84567cf63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:39.663684 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ca6d6f00-27ab-42ec-9785-b1d84567cf63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:39.665134 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ca6d6f00-27ab-42ec-9785-b1d84567cf63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.181107 Jun 27 15:27:39.665702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 80/155] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:39 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:39.838242 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e58b7c04-7f9f-46d0-b996-165b5a85c0cc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:39.839019 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e58b7c04-7f9f-46d0-b996-165b5a85c0cc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:39.845422 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e58b7c04-7f9f-46d0-b996-165b5a85c0cc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:39.845895 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e58b7c04-7f9f-46d0-b996-165b5a85c0cc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:39.846780 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e58b7c04-7f9f-46d0-b996-165b5a85c0cc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:39.847186 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e58b7c04-7f9f-46d0-b996-165b5a85c0cc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:40.005695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e58b7c04-7f9f-46d0-b996-165b5a85c0cc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:40.016353 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e58b7c04-7f9f-46d0-b996-165b5a85c0cc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.181758 Jun 27 15:27:40.017219 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 76/156] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:39 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:40.683737 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6072317f-b0e6-4a30-b093-0960bac2bde2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:40.684875 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6072317f-b0e6-4a30-b093-0960bac2bde2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:40.693945 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6072317f-b0e6-4a30-b093-0960bac2bde2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:40.694385 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6072317f-b0e6-4a30-b093-0960bac2bde2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:40.695212 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6072317f-b0e6-4a30-b093-0960bac2bde2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:40.695640 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6072317f-b0e6-4a30-b093-0960bac2bde2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:40.855029 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6072317f-b0e6-4a30-b093-0960bac2bde2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:40.863862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6072317f-b0e6-4a30-b093-0960bac2bde2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:40.865391 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6072317f-b0e6-4a30-b093-0960bac2bde2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:40.866525 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6072317f-b0e6-4a30-b093-0960bac2bde2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1405 microversion: 2.20 time: 0.187004 Jun 27 15:27:40.867089 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 81/157] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:40 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:41.042470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d883e46f-ce26-4948-be9a-c109490df2f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:41.043248 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d883e46f-ce26-4948-be9a-c109490df2f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:41.050714 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d883e46f-ce26-4948-be9a-c109490df2f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:41.051154 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d883e46f-ce26-4948-be9a-c109490df2f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:41.051936 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d883e46f-ce26-4948-be9a-c109490df2f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:41.052399 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d883e46f-ce26-4948-be9a-c109490df2f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:41.212017 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d883e46f-ce26-4948-be9a-c109490df2f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:41.220485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d883e46f-ce26-4948-be9a-c109490df2f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.181909 Jun 27 15:27:41.221798 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 77/158] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:41 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:41.886347 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e67aefab-6581-4209-98dd-d6b7d30c8f29 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:41.887032 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e67aefab-6581-4209-98dd-d6b7d30c8f29 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:41.894320 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e67aefab-6581-4209-98dd-d6b7d30c8f29 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:41.894758 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e67aefab-6581-4209-98dd-d6b7d30c8f29 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:41.895544 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e67aefab-6581-4209-98dd-d6b7d30c8f29 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:41.895971 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e67aefab-6581-4209-98dd-d6b7d30c8f29 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:42.124294 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e67aefab-6581-4209-98dd-d6b7d30c8f29 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:42.137543 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e67aefab-6581-4209-98dd-d6b7d30c8f29 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:42.140861 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e67aefab-6581-4209-98dd-d6b7d30c8f29 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:42.143130 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e67aefab-6581-4209-98dd-d6b7d30c8f29 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1598 microversion: 2.20 time: 0.260770 Jun 27 15:27:42.144089 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 82/159] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:27:41 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1598 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:27:42.172106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3d5d62ec-0bef-48a8-ad39-7751778f5f0d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:42.172863 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3d5d62ec-0bef-48a8-ad39-7751778f5f0d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:42.185250 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3d5d62ec-0bef-48a8-ad39-7751778f5f0d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:42.185925 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3d5d62ec-0bef-48a8-ad39-7751778f5f0d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:42.187345 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3d5d62ec-0bef-48a8-ad39-7751778f5f0d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:42.188241 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3d5d62ec-0bef-48a8-ad39-7751778f5f0d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:42.241961 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6fff7ee9-b127-4e94-a884-3a787db88184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:42.242589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6fff7ee9-b127-4e94-a884-3a787db88184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:42.250035 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6fff7ee9-b127-4e94-a884-3a787db88184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:42.250477 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6fff7ee9-b127-4e94-a884-3a787db88184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:42.251940 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6fff7ee9-b127-4e94-a884-3a787db88184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:42.253010 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6fff7ee9-b127-4e94-a884-3a787db88184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:42.325741 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3d5d62ec-0bef-48a8-ad39-7751778f5f0d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.161096 Jun 27 15:27:42.328385 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 78/160] 10.222.0.26 () {60 vars in 1315 bytes} [Mon Jun 27 15:27:42 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-interface => generated 285 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:27:42.999652 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6fff7ee9-b127-4e94-a884-3a787db88184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:43.008430 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6fff7ee9-b127-4e94-a884-3a787db88184 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.770833 Jun 27 15:27:43.009011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 83/161] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:42 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 772 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:44.035362 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-db68150c-7bbf-4579-9422-dc029bbb30f5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:44.036473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-db68150c-7bbf-4579-9422-dc029bbb30f5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:44.045528 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-db68150c-7bbf-4579-9422-dc029bbb30f5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:44.046200 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-db68150c-7bbf-4579-9422-dc029bbb30f5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:44.047144 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-db68150c-7bbf-4579-9422-dc029bbb30f5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:44.047737 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-db68150c-7bbf-4579-9422-dc029bbb30f5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:44.283607 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-db68150c-7bbf-4579-9422-dc029bbb30f5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:44.297009 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-db68150c-7bbf-4579-9422-dc029bbb30f5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.269121 Jun 27 15:27:44.308344 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 79/162] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:44 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:44.483473 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-9bbd21e4-7c9f-4c21-b0a6-4470d707461e req-79e0bb9f-3c47-4adc-a80a-9f1bff58197b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "831291d0-f04d-4927-afcd-88fd058db642", "tag": "62696634-23e0-4313-bcf8-d3be6665d3aa"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:44.495934 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-9bbd21e4-7c9f-4c21-b0a6-4470d707461e req-79e0bb9f-3c47-4adc-a80a-9f1bff58197b service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:44.496545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-9bbd21e4-7c9f-4c21-b0a6-4470d707461e req-79e0bb9f-3c47-4adc-a80a-9f1bff58197b service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:44.509363 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-9bbd21e4-7c9f-4c21-b0a6-4470d707461e req-79e0bb9f-3c47-4adc-a80a-9f1bff58197b service nova] Creating event network-changed:62696634-23e0-4313-bcf8-d3be6665d3aa for instance 831291d0-f04d-4927-afcd-88fd058db642 on hv-cinder-84779 Jun 27 15:27:44.515018 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-9bbd21e4-7c9f-4c21-b0a6-4470d707461e req-79e0bb9f-3c47-4adc-a80a-9f1bff58197b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035528 Jun 27 15:27:44.516167 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 84/163] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:45.322886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7e3898b0-85ab-4e93-a954-2a506b7dd088 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:45.323529 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7e3898b0-85ab-4e93-a954-2a506b7dd088 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:45.331328 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e3898b0-85ab-4e93-a954-2a506b7dd088 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:45.331773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e3898b0-85ab-4e93-a954-2a506b7dd088 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:45.332590 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e3898b0-85ab-4e93-a954-2a506b7dd088 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:45.333014 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e3898b0-85ab-4e93-a954-2a506b7dd088 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:45.515999 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7e3898b0-85ab-4e93-a954-2a506b7dd088 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:45.527951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7e3898b0-85ab-4e93-a954-2a506b7dd088 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.208979 Jun 27 15:27:45.528547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 80/164] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:45 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:46.553350 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bdbf23c3-0b25-4f42-895b-85785a0a0ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:46.554628 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bdbf23c3-0b25-4f42-895b-85785a0a0ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:46.568487 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bdbf23c3-0b25-4f42-895b-85785a0a0ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:46.569308 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bdbf23c3-0b25-4f42-895b-85785a0a0ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:46.570672 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bdbf23c3-0b25-4f42-895b-85785a0a0ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:46.571434 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bdbf23c3-0b25-4f42-895b-85785a0a0ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:46.744867 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bdbf23c3-0b25-4f42-895b-85785a0a0ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:46.753076 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bdbf23c3-0b25-4f42-895b-85785a0a0ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.209532 Jun 27 15:27:46.753671 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 85/165] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:46 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:47.770267 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fa93c7e9-d1ba-48a1-9f2e-51f8d35c0259 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:47.770900 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-fa93c7e9-d1ba-48a1-9f2e-51f8d35c0259 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:47.777959 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa93c7e9-d1ba-48a1-9f2e-51f8d35c0259 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:47.778399 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa93c7e9-d1ba-48a1-9f2e-51f8d35c0259 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:47.779165 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa93c7e9-d1ba-48a1-9f2e-51f8d35c0259 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:47.779689 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa93c7e9-d1ba-48a1-9f2e-51f8d35c0259 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:47.942439 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fa93c7e9-d1ba-48a1-9f2e-51f8d35c0259 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:47.950773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fa93c7e9-d1ba-48a1-9f2e-51f8d35c0259 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.184501 Jun 27 15:27:47.951351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 81/166] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:47 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:48.969859 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6846647e-095b-43d0-8eb0-905f0c7de5e3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:48.971340 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6846647e-095b-43d0-8eb0-905f0c7de5e3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:48.980468 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6846647e-095b-43d0-8eb0-905f0c7de5e3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:48.981235 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6846647e-095b-43d0-8eb0-905f0c7de5e3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:48.982247 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6846647e-095b-43d0-8eb0-905f0c7de5e3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:48.993283 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6846647e-095b-43d0-8eb0-905f0c7de5e3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:49.196376 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6846647e-095b-43d0-8eb0-905f0c7de5e3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:49.206302 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6846647e-095b-43d0-8eb0-905f0c7de5e3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.240375 Jun 27 15:27:49.217253 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 86/167] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:48 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:50.243347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d188119e-0375-4606-9061-05ec477e648c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:50.244554 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d188119e-0375-4606-9061-05ec477e648c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:50.273177 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d188119e-0375-4606-9061-05ec477e648c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:50.273636 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d188119e-0375-4606-9061-05ec477e648c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:50.277276 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d188119e-0375-4606-9061-05ec477e648c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:50.277788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d188119e-0375-4606-9061-05ec477e648c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:50.282598 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-223cb57e-769b-4765-abf7-1fc4cc12768d tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:50.284565 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-223cb57e-769b-4765-abf7-1fc4cc12768d tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:50.298055 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-223cb57e-769b-4765-abf7-1fc4cc12768d tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:50.299918 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-223cb57e-769b-4765-abf7-1fc4cc12768d tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:50.302306 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-223cb57e-769b-4765-abf7-1fc4cc12768d tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:50.303234 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-223cb57e-769b-4765-abf7-1fc4cc12768d tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:50.351858 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:50.382494 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-223cb57e-769b-4765-abf7-1fc4cc12768d tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:27:50.598390 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d188119e-0375-4606-9061-05ec477e648c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:50.607559 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-223cb57e-769b-4765-abf7-1fc4cc12768d tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "DELETE /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 204 len: 0 microversion: 2.1 time: 0.333703 Jun 27 15:27:50.608120 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d188119e-0375-4606-9061-05ec477e648c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.373355 Jun 27 15:27:50.608771 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 82/168] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:50 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:50.609361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 87/169] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:27:50 2022] DELETE /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:27:50.619674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4e18bcf2-b444-4734-9363-e80787bf9ead tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:50.620554 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4e18bcf2-b444-4734-9363-e80787bf9ead tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:50.627985 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4e18bcf2-b444-4734-9363-e80787bf9ead tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:50.628388 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4e18bcf2-b444-4734-9363-e80787bf9ead tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:50.629428 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4e18bcf2-b444-4734-9363-e80787bf9ead tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:50.629785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4e18bcf2-b444-4734-9363-e80787bf9ead tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:50.823784 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4e18bcf2-b444-4734-9363-e80787bf9ead tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:50.834850 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4e18bcf2-b444-4734-9363-e80787bf9ead tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1554 microversion: 2.1 time: 0.219641 Jun 27 15:27:50.835939 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 83/170] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:50 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1554 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:51.639807 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-938aa5ea-da5f-404b-975e-8a0a5482296a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:51.641033 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-938aa5ea-da5f-404b-975e-8a0a5482296a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:51.661077 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-938aa5ea-da5f-404b-975e-8a0a5482296a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:51.661077 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-938aa5ea-da5f-404b-975e-8a0a5482296a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:51.662546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-938aa5ea-da5f-404b-975e-8a0a5482296a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:51.663581 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-938aa5ea-da5f-404b-975e-8a0a5482296a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:51.870475 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-43603bb1-7578-41df-a86d-d432866dbd3a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:51.872583 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-43603bb1-7578-41df-a86d-d432866dbd3a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:51.888009 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-43603bb1-7578-41df-a86d-d432866dbd3a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:51.889393 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-43603bb1-7578-41df-a86d-d432866dbd3a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:51.891145 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-43603bb1-7578-41df-a86d-d432866dbd3a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:51.893374 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-43603bb1-7578-41df-a86d-d432866dbd3a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:51.908423 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-938aa5ea-da5f-404b-975e-8a0a5482296a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:51.920036 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-938aa5ea-da5f-404b-975e-8a0a5482296a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.287925 Jun 27 15:27:51.921748 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 88/171] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:51 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:52.113991 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-43603bb1-7578-41df-a86d-d432866dbd3a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:52.128076 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-43603bb1-7578-41df-a86d-d432866dbd3a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1554 microversion: 2.1 time: 0.275046 Jun 27 15:27:52.129174 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 84/172] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:51 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1554 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:52.947559 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1fd881c7-561f-4be6-b153-2f56885774e5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:52.948501 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1fd881c7-561f-4be6-b153-2f56885774e5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:52.955257 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fd881c7-561f-4be6-b153-2f56885774e5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:52.955987 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fd881c7-561f-4be6-b153-2f56885774e5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:52.956805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fd881c7-561f-4be6-b153-2f56885774e5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:52.957420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fd881c7-561f-4be6-b153-2f56885774e5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:53.152430 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5f543eca-cd34-4278-90fe-ebc25c35a95a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:53.153905 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5f543eca-cd34-4278-90fe-ebc25c35a95a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:53.161004 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5f543eca-cd34-4278-90fe-ebc25c35a95a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:53.161791 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5f543eca-cd34-4278-90fe-ebc25c35a95a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:53.162824 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5f543eca-cd34-4278-90fe-ebc25c35a95a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:53.163486 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5f543eca-cd34-4278-90fe-ebc25c35a95a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:53.310489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fd881c7-561f-4be6-b153-2f56885774e5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:53.321856 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1fd881c7-561f-4be6-b153-2f56885774e5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.377994 Jun 27 15:27:53.323142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 89/173] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:52 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:53.361150 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5f543eca-cd34-4278-90fe-ebc25c35a95a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:53.376129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5f543eca-cd34-4278-90fe-ebc25c35a95a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1554 microversion: 2.1 time: 0.227687 Jun 27 15:27:53.379160 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 85/174] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:53 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1554 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:54.167706 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-c8649c1f-84d3-4378-8e92-824adce65da3 req-1e7ef949-cf27-4569-a6ad-c671929a8726 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05ad818a-43eb-47d0-a466-eeeec96fd758", "name": "network-vif-deleted", "tag": "d3ed4003-b3bf-4b78-872f-0deb501c8889"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:27:54.196509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-c8649c1f-84d3-4378-8e92-824adce65da3 req-1e7ef949-cf27-4569-a6ad-c671929a8726 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:54.198051 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-c8649c1f-84d3-4378-8e92-824adce65da3 req-1e7ef949-cf27-4569-a6ad-c671929a8726 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:54.227828 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-c8649c1f-84d3-4378-8e92-824adce65da3 req-1e7ef949-cf27-4569-a6ad-c671929a8726 service nova] Creating event network-vif-deleted:d3ed4003-b3bf-4b78-872f-0deb501c8889 for instance 05ad818a-43eb-47d0-a466-eeeec96fd758 on hv-cinder-84779 Jun 27 15:27:54.237976 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-c8649c1f-84d3-4378-8e92-824adce65da3 req-1e7ef949-cf27-4569-a6ad-c671929a8726 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083754 Jun 27 15:27:54.239571 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 90/175] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:27:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:27:54.340892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-26363da2-a604-40d1-90cd-713c6d43f247 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:54.341750 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-26363da2-a604-40d1-90cd-713c6d43f247 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:54.348573 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-26363da2-a604-40d1-90cd-713c6d43f247 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:54.349038 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-26363da2-a604-40d1-90cd-713c6d43f247 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:54.350238 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-26363da2-a604-40d1-90cd-713c6d43f247 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:54.350838 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-26363da2-a604-40d1-90cd-713c6d43f247 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:54.404718 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7bac0ebb-a8ac-495d-b572-1e3741f47302 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:54.407686 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7bac0ebb-a8ac-495d-b572-1e3741f47302 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:54.447683 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7bac0ebb-a8ac-495d-b572-1e3741f47302 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:54.468491 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7bac0ebb-a8ac-495d-b572-1e3741f47302 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:54.477193 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7bac0ebb-a8ac-495d-b572-1e3741f47302 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:54.478473 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7bac0ebb-a8ac-495d-b572-1e3741f47302 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:54.657700 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7bac0ebb-a8ac-495d-b572-1e3741f47302 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5e2597ff867544f9953c519bf29a9bfa', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05e46da777a54cbe92cbfb00c37d8bb5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:54.698122 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7bac0ebb-a8ac-495d-b572-1e3741f47302 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 200 len: 1346 microversion: 2.1 time: 0.302037 Jun 27 15:27:54.712363 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 91/176] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:54 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 1346 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:54.818642 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-26363da2-a604-40d1-90cd-713c6d43f247 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:54.875262 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-26363da2-a604-40d1-90cd-713c6d43f247 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.539061 Jun 27 15:27:54.877764 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 86/177] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:54 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:55.731262 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-42475086-7148-4fcd-950c-628e71edaeef tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:55.732043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-42475086-7148-4fcd-950c-628e71edaeef tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:55.746307 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42475086-7148-4fcd-950c-628e71edaeef tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:55.747056 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42475086-7148-4fcd-950c-628e71edaeef tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:55.749162 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42475086-7148-4fcd-950c-628e71edaeef tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:55.749834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42475086-7148-4fcd-950c-628e71edaeef tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:55.767884 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-42475086-7148-4fcd-950c-628e71edaeef tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] HTTP exception thrown: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-42475086-7148-4fcd-950c-628e71edaeef tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Request method failure captured: Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 HTTP/1.1 Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwkRU_jY_AG3bJl3_G8O2QfFfHLOzg1m6PcpossSKtrwuDXY3H7gU41vLfm_7Lv7zeMD7CL2zSeelLUutb-eCg5_Sxxw6W0Yz-XiruURSkGIaaHsCZcEpv-KeeL9WSZ8UKiyPhtMPLkWq-7vs7OeE4HIo9cVOPW9jccseJimBLsQCI Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 05e46da777a54cbe92cbfb00c37d8bb5 Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:27:55.776908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05e46da777a54cbe92cbfb00c37d8bb5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 05e46da777a54cbe92cbfb00c37d8bb5 Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-DeleteServersTestJSON-1968028981-project Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 5e2597ff867544f9953c519bf29a9bfa Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-DeleteServersTestJSON-1968028981-project Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:55.778368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '05ad818a-43eb-47d0-a466-eeeec96fd758'} Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:27:55.779150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:55.780533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:27:55.781675 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-42475086-7148-4fcd-950c-628e71edaeef tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Returning 404 to user: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:27:55.781675 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-42475086-7148-4fcd-950c-628e71edaeef tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 404 len: 111 microversion: 2.1 time: 0.051747 Jun 27 15:27:55.781675 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 92/178] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:55 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:27:55.904741 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b33a9597-3032-438b-8bba-46e4f1bf35db tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:55.905221 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b33a9597-3032-438b-8bba-46e4f1bf35db tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:55.915877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fdcc2b0c-cf8a-477f-91d1-866df6899459 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:55.917915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fdcc2b0c-cf8a-477f-91d1-866df6899459 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:55.918272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b33a9597-3032-438b-8bba-46e4f1bf35db tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:55.918723 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b33a9597-3032-438b-8bba-46e4f1bf35db tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:55.921095 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b33a9597-3032-438b-8bba-46e4f1bf35db tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:55.921583 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b33a9597-3032-438b-8bba-46e4f1bf35db tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:55.926529 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdcc2b0c-cf8a-477f-91d1-866df6899459 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:55.927298 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdcc2b0c-cf8a-477f-91d1-866df6899459 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:55.928626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdcc2b0c-cf8a-477f-91d1-866df6899459 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:55.929088 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdcc2b0c-cf8a-477f-91d1-866df6899459 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:55.940001 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=100 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:55.950012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-fdcc2b0c-cf8a-477f-91d1-866df6899459 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] HTTP exception thrown: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fdcc2b0c-cf8a-477f-91d1-866df6899459 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Request method failure captured: Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758/os-volume_attachments HTTP/1.1 Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwkRU_jY_AG3bJl3_G8O2QfFfHLOzg1m6PcpossSKtrwuDXY3H7gU41vLfm_7Lv7zeMD7CL2zSeelLUutb-eCg5_Sxxw6W0Yz-XiruURSkGIaaHsCZcEpv-KeeL9WSZ8UKiyPhtMPLkWq-7vs7OeE4HIo9cVOPW9jccseJimBLsQCI Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 05e46da777a54cbe92cbfb00c37d8bb5 Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:27:55.958822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05e46da777a54cbe92cbfb00c37d8bb5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 05e46da777a54cbe92cbfb00c37d8bb5 Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-DeleteServersTestJSON-1968028981-project Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 5e2597ff867544f9953c519bf29a9bfa Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-DeleteServersTestJSON-1968028981-project Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:55.960191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'server_id': '05ad818a-43eb-47d0-a466-eeeec96fd758'} Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:27:55.960963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:55.962126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:27:55.963370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fdcc2b0c-cf8a-477f-91d1-866df6899459 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Returning 404 to user: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:27:55.963370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fdcc2b0c-cf8a-477f-91d1-866df6899459 tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049957 Jun 27 15:27:55.966435 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 93/179] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:27:55 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758/os-volume_attachments => generated 111 bytes in 55 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:27:56.128186 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b33a9597-3032-438b-8bba-46e4f1bf35db tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:56.136480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b33a9597-3032-438b-8bba-46e4f1bf35db tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.237351 Jun 27 15:27:56.139424 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 87/180] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:55 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:27:57.157537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4038a8c2-3410-49c4-99d5-5a5e8a9f21d6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:57.159654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4038a8c2-3410-49c4-99d5-5a5e8a9f21d6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:57.170178 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4038a8c2-3410-49c4-99d5-5a5e8a9f21d6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:57.170894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4038a8c2-3410-49c4-99d5-5a5e8a9f21d6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:57.171839 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4038a8c2-3410-49c4-99d5-5a5e8a9f21d6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:57.172465 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4038a8c2-3410-49c4-99d5-5a5e8a9f21d6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:57.395724 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6b6f2cdb-4d7e-41cf-8673-6603624df63e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:57.398321 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-6b6f2cdb-4d7e-41cf-8673-6603624df63e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:57.423161 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=58 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:27:57.425276 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6b6f2cdb-4d7e-41cf-8673-6603624df63e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:57.425909 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6b6f2cdb-4d7e-41cf-8673-6603624df63e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:57.426843 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6b6f2cdb-4d7e-41cf-8673-6603624df63e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:57.427420 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6b6f2cdb-4d7e-41cf-8673-6603624df63e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:57.450202 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-6b6f2cdb-4d7e-41cf-8673-6603624df63e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] HTTP exception thrown: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6b6f2cdb-4d7e-41cf-8673-6603624df63e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Request method failure captured: Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: DELETE /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 HTTP/1.1 Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwkRU_jY_AG3bJl3_G8O2QfFfHLOzg1m6PcpossSKtrwuDXY3H7gU41vLfm_7Lv7zeMD7CL2zSeelLUutb-eCg5_Sxxw6W0Yz-XiruURSkGIaaHsCZcEpv-KeeL9WSZ8UKiyPhtMPLkWq-7vs7OeE4HIo9cVOPW9jccseJimBLsQCI Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 05e46da777a54cbe92cbfb00c37d8bb5 Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:27:57.457049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05e46da777a54cbe92cbfb00c37d8bb5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 05e46da777a54cbe92cbfb00c37d8bb5 Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-DeleteServersTestJSON-1968028981-project Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 5e2597ff867544f9953c519bf29a9bfa Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-DeleteServersTestJSON-1968028981-project Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:57.458364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '05ad818a-43eb-47d0-a466-eeeec96fd758'} Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:27:57.459104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:57.460169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:27:57.464050 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6b6f2cdb-4d7e-41cf-8673-6603624df63e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Returning 404 to user: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:27:57.465217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-6b6f2cdb-4d7e-41cf-8673-6603624df63e tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "DELETE /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 404 len: 111 microversion: 2.1 time: 0.080675 Jun 27 15:27:57.466064 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 88/181] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:27:57 2022] DELETE /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:27:57.478440 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-cac0307d-7600-428c-a834-25a4d2a4742a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:57.479585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-cac0307d-7600-428c-a834-25a4d2a4742a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] [instance: 05ad818a-43eb-47d0-a466-eeeec96fd758] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:57.488268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cac0307d-7600-428c-a834-25a4d2a4742a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:57.489077 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cac0307d-7600-428c-a834-25a4d2a4742a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:57.490148 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cac0307d-7600-428c-a834-25a4d2a4742a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:57.491047 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cac0307d-7600-428c-a834-25a4d2a4742a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:57.521788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-cac0307d-7600-428c-a834-25a4d2a4742a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] HTTP exception thrown: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-cac0307d-7600-428c-a834-25a4d2a4742a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Request method failure captured: Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 HTTP/1.1 Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwkRU_jY_AG3bJl3_G8O2QfFfHLOzg1m6PcpossSKtrwuDXY3H7gU41vLfm_7Lv7zeMD7CL2zSeelLUutb-eCg5_Sxxw6W0Yz-XiruURSkGIaaHsCZcEpv-KeeL9WSZ8UKiyPhtMPLkWq-7vs7OeE4HIo9cVOPW9jccseJimBLsQCI Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 05e46da777a54cbe92cbfb00c37d8bb5 Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:27:57.524028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_05e46da777a54cbe92cbfb00c37d8bb5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/05e46da777a54cbe92cbfb00c37d8bb5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 05e46da777a54cbe92cbfb00c37d8bb5 Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-DeleteServersTestJSON-1968028981 Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-DeleteServersTestJSON-1968028981-project Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 5e2597ff867544f9953c519bf29a9bfa Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-DeleteServersTestJSON-1968028981-project Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:57.525749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '05ad818a-43eb-47d0-a466-eeeec96fd758'} Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:27:57.526470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. Jun 27 15:27:57.527489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:27:57.529979 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-cac0307d-7600-428c-a834-25a4d2a4742a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] Returning 404 to user: Instance 05ad818a-43eb-47d0-a466-eeeec96fd758 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:27:57.531111 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-cac0307d-7600-428c-a834-25a4d2a4742a tempest-DeleteServersTestJSON-1968028981 tempest-DeleteServersTestJSON-1968028981-project] 10.222.0.26 "GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758" status: 404 len: 111 microversion: 2.1 time: 0.059956 Jun 27 15:27:57.532148 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 89/182] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:57 2022] GET /compute/v2.1/servers/05ad818a-43eb-47d0-a466-eeeec96fd758 => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:27:57.628905 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4038a8c2-3410-49c4-99d5-5a5e8a9f21d6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:57.678380 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4038a8c2-3410-49c4-99d5-5a5e8a9f21d6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.524614 Jun 27 15:27:57.681447 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 94/183] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:57 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:27:58.699078 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e4e1f73f-b9e4-433a-9c64-c9ad434b398d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:27:58.700013 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e4e1f73f-b9e4-433a-9c64-c9ad434b398d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:27:58.728097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4e1f73f-b9e4-433a-9c64-c9ad434b398d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:58.731710 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4e1f73f-b9e4-433a-9c64-c9ad434b398d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:58.733051 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4e1f73f-b9e4-433a-9c64-c9ad434b398d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:27:58.739718 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4e1f73f-b9e4-433a-9c64-c9ad434b398d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:27:59.129045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e4e1f73f-b9e4-433a-9c64-c9ad434b398d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:27:59.143387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e4e1f73f-b9e4-433a-9c64-c9ad434b398d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.448702 Jun 27 15:27:59.144818 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 90/184] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:27:58 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:00.181554 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-84e5c2e9-5001-48d3-86d8-2d584731997f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:00.182254 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-84e5c2e9-5001-48d3-86d8-2d584731997f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:00.213681 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:00.226147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84e5c2e9-5001-48d3-86d8-2d584731997f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:00.227119 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84e5c2e9-5001-48d3-86d8-2d584731997f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:00.228611 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84e5c2e9-5001-48d3-86d8-2d584731997f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:00.229355 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-84e5c2e9-5001-48d3-86d8-2d584731997f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:00.709099 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-84e5c2e9-5001-48d3-86d8-2d584731997f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:00.717824 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-84e5c2e9-5001-48d3-86d8-2d584731997f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.548073 Jun 27 15:28:00.720206 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 95/185] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:00 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:01.735304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-bc0abc11-bdd8-4235-9cab-5a432a6a0763 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:01.735939 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-bc0abc11-bdd8-4235-9cab-5a432a6a0763 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:01.743380 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bc0abc11-bdd8-4235-9cab-5a432a6a0763 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:01.743868 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bc0abc11-bdd8-4235-9cab-5a432a6a0763 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:01.744676 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bc0abc11-bdd8-4235-9cab-5a432a6a0763 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:01.745457 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bc0abc11-bdd8-4235-9cab-5a432a6a0763 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:01.975175 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-bc0abc11-bdd8-4235-9cab-5a432a6a0763 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:01.989833 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-bc0abc11-bdd8-4235-9cab-5a432a6a0763 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.257882 Jun 27 15:28:01.990704 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 91/186] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:01 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:03.008280 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8e795b4d-d1e6-49ff-beb6-5253f9cd0c6c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:03.009749 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8e795b4d-d1e6-49ff-beb6-5253f9cd0c6c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:03.016205 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e795b4d-d1e6-49ff-beb6-5253f9cd0c6c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:03.016958 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e795b4d-d1e6-49ff-beb6-5253f9cd0c6c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:03.018490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e795b4d-d1e6-49ff-beb6-5253f9cd0c6c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:03.019377 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8e795b4d-d1e6-49ff-beb6-5253f9cd0c6c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:03.271186 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8e795b4d-d1e6-49ff-beb6-5253f9cd0c6c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:03.279785 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8e795b4d-d1e6-49ff-beb6-5253f9cd0c6c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.275588 Jun 27 15:28:03.280410 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 96/187] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:03 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:03.436599 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-886285551", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "networks": [{"uuid": "2579e3bc-4a9d-498c-82ba-b2ed0949972e"}]}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:03.504151 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] validate_networks() for [('2579e3bc-4a9d-498c-82ba-b2ed0949972e', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:28:04.052169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:28:04.052631 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:28:04.053204 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:28:04.053498 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:28:04.053961 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:28:04.065757 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:04.066361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:04.067136 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:04.067567 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:04.090183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Getting quotas for project b99a389f8cd34552ae1b3c30803669ae. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:28:04.096821 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Getting quotas for user b9d9cb0073b5452698e549792adf6733 and project b99a389f8cd34552ae1b3c30803669ae. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:28:04.113531 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:28:04.116418 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:28:04.210459 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b86e36b6-7289-491c-9c20-c10425599069 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772355 Jun 27 15:28:04.210459 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 92/188] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:28:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 777 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:28:04.226676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a315c264-0626-4bbe-b58f-f9e8149df69d tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:04.227749 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a315c264-0626-4bbe-b58f-f9e8149df69d tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:04.301503 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7a45298f-f1e8-4418-b48b-48215e466a48 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:04.302345 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7a45298f-f1e8-4418-b48b-48215e466a48 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:04.318637 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7a45298f-f1e8-4418-b48b-48215e466a48 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:04.318963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a315c264-0626-4bbe-b58f-f9e8149df69d tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:04.319178 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7a45298f-f1e8-4418-b48b-48215e466a48 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:04.319959 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7a45298f-f1e8-4418-b48b-48215e466a48 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:04.320444 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7a45298f-f1e8-4418-b48b-48215e466a48 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:04.334936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a315c264-0626-4bbe-b58f-f9e8149df69d tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1213 microversion: 2.1 time: 0.117265 Jun 27 15:28:04.337674 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 97/189] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:04 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1213 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:04.509988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7a45298f-f1e8-4418-b48b-48215e466a48 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:04.520598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7a45298f-f1e8-4418-b48b-48215e466a48 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.224351 Jun 27 15:28:04.521375 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 93/190] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:04 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:05.363248 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e2348c5d-ce12-49b3-be71-9d1dad5571bc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:05.365824 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e2348c5d-ce12-49b3-be71-9d1dad5571bc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:05.405196 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2348c5d-ce12-49b3-be71-9d1dad5571bc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:05.405537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2348c5d-ce12-49b3-be71-9d1dad5571bc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:05.410173 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2348c5d-ce12-49b3-be71-9d1dad5571bc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:05.410864 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e2348c5d-ce12-49b3-be71-9d1dad5571bc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:05.540416 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6e44533e-9ca2-47c8-9a18-59454e497882 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:05.541086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-6e44533e-9ca2-47c8-9a18-59454e497882 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:05.551194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6e44533e-9ca2-47c8-9a18-59454e497882 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:05.551647 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6e44533e-9ca2-47c8-9a18-59454e497882 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:05.555503 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6e44533e-9ca2-47c8-9a18-59454e497882 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:05.555950 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6e44533e-9ca2-47c8-9a18-59454e497882 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:05.568162 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e2348c5d-ce12-49b3-be71-9d1dad5571bc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:05.585710 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e2348c5d-ce12-49b3-be71-9d1dad5571bc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1209 microversion: 2.1 time: 0.232956 Jun 27 15:28:05.596737 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 98/191] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:05 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1209 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:05.838081 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6e44533e-9ca2-47c8-9a18-59454e497882 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:05.854903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-6e44533e-9ca2-47c8-9a18-59454e497882 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.318773 Jun 27 15:28:05.856005 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 94/192] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:05 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:06.604289 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e4dd7d4a-6613-4cb4-a501-d4e637753fb0 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:06.605616 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e4dd7d4a-6613-4cb4-a501-d4e637753fb0 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:06.614306 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4dd7d4a-6613-4cb4-a501-d4e637753fb0 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:06.615149 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4dd7d4a-6613-4cb4-a501-d4e637753fb0 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:06.617082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4dd7d4a-6613-4cb4-a501-d4e637753fb0 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:06.618073 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4dd7d4a-6613-4cb4-a501-d4e637753fb0 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:06.738377 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e4dd7d4a-6613-4cb4-a501-d4e637753fb0 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:06.753747 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e4dd7d4a-6613-4cb4-a501-d4e637753fb0 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1273 microversion: 2.1 time: 0.151949 Jun 27 15:28:06.755799 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 99/193] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:06 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1273 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:06.885955 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d0311c02-21f6-47c7-a781-ea23fd9b5061 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:06.888815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d0311c02-21f6-47c7-a781-ea23fd9b5061 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:06.901978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d0311c02-21f6-47c7-a781-ea23fd9b5061 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:06.903163 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d0311c02-21f6-47c7-a781-ea23fd9b5061 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:06.905131 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d0311c02-21f6-47c7-a781-ea23fd9b5061 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:06.910020 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d0311c02-21f6-47c7-a781-ea23fd9b5061 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:07.170021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d0311c02-21f6-47c7-a781-ea23fd9b5061 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:07.207260 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d0311c02-21f6-47c7-a781-ea23fd9b5061 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1521 microversion: 2.1 time: 0.330407 Jun 27 15:28:07.213458 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 95/194] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:06 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:07.777238 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d188d388-672f-4f4c-9faa-2b58c12376a1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:07.778661 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d188d388-672f-4f4c-9faa-2b58c12376a1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:07.801300 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d188d388-672f-4f4c-9faa-2b58c12376a1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:07.802121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d188d388-672f-4f4c-9faa-2b58c12376a1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:07.803794 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d188d388-672f-4f4c-9faa-2b58c12376a1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:07.805539 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d188d388-672f-4f4c-9faa-2b58c12376a1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:07.964719 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d188d388-672f-4f4c-9faa-2b58c12376a1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:07.976447 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d188d388-672f-4f4c-9faa-2b58c12376a1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1271 microversion: 2.1 time: 0.207107 Jun 27 15:28:07.978509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 100/195] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:07 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1271 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:08.243873 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5582f9af-4681-440a-95d8-9a3ea2ca6623 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:08.245680 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5582f9af-4681-440a-95d8-9a3ea2ca6623 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:08.271319 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5582f9af-4681-440a-95d8-9a3ea2ca6623 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:08.274050 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5582f9af-4681-440a-95d8-9a3ea2ca6623 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:08.276383 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5582f9af-4681-440a-95d8-9a3ea2ca6623 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:08.277267 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5582f9af-4681-440a-95d8-9a3ea2ca6623 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:08.509909 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5582f9af-4681-440a-95d8-9a3ea2ca6623 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:08.527412 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5582f9af-4681-440a-95d8-9a3ea2ca6623 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1501 microversion: 2.1 time: 0.293820 Jun 27 15:28:08.530192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 96/196] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:08 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:08.560803 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-53e208ed-e192-4a87-b09e-4fb6f88e41f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:08.562767 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-53e208ed-e192-4a87-b09e-4fb6f88e41f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:08.585949 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53e208ed-e192-4a87-b09e-4fb6f88e41f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:08.587575 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53e208ed-e192-4a87-b09e-4fb6f88e41f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:08.591692 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53e208ed-e192-4a87-b09e-4fb6f88e41f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:08.592996 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-53e208ed-e192-4a87-b09e-4fb6f88e41f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:09.017645 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-24fb8705-493d-445f-8224-1cb5dcc392b6 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:09.025947 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-24fb8705-493d-445f-8224-1cb5dcc392b6 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:09.076275 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-24fb8705-493d-445f-8224-1cb5dcc392b6 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:09.076764 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-24fb8705-493d-445f-8224-1cb5dcc392b6 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:09.077591 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-24fb8705-493d-445f-8224-1cb5dcc392b6 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:09.078146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-24fb8705-493d-445f-8224-1cb5dcc392b6 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:09.249856 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-53e208ed-e192-4a87-b09e-4fb6f88e41f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:09.272964 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-53e208ed-e192-4a87-b09e-4fb6f88e41f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1516 microversion: 2.1 time: 0.723183 Jun 27 15:28:09.290243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 101/197] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:08 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1516 bytes in 742 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:09.300966 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-24fb8705-493d-445f-8224-1cb5dcc392b6 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:09.360648 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-24fb8705-493d-445f-8224-1cb5dcc392b6 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1271 microversion: 2.1 time: 0.352513 Jun 27 15:28:09.362270 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 97/198] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:08 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1271 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:10.386362 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b676fc2c-de06-40de-b5d2-607592193a4f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:10.387808 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b676fc2c-de06-40de-b5d2-607592193a4f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:10.395620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b676fc2c-de06-40de-b5d2-607592193a4f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:10.396524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b676fc2c-de06-40de-b5d2-607592193a4f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:10.397564 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b676fc2c-de06-40de-b5d2-607592193a4f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:10.398238 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b676fc2c-de06-40de-b5d2-607592193a4f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:10.863317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b676fc2c-de06-40de-b5d2-607592193a4f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:10.878347 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b676fc2c-de06-40de-b5d2-607592193a4f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1313 microversion: 2.1 time: 0.496472 Jun 27 15:28:10.883136 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 102/199] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:10 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:11.383012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-00fcf31e-7328-470e-9d7c-042cdd6fe72a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:11.385017 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-00fcf31e-7328-470e-9d7c-042cdd6fe72a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:11.398190 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-00fcf31e-7328-470e-9d7c-042cdd6fe72a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:11.399332 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-00fcf31e-7328-470e-9d7c-042cdd6fe72a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:11.401170 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-00fcf31e-7328-470e-9d7c-042cdd6fe72a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:11.402500 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-00fcf31e-7328-470e-9d7c-042cdd6fe72a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:11.461722 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-00fcf31e-7328-470e-9d7c-042cdd6fe72a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lazy-loading 'flavor' on Instance uuid 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:28:11.643067 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-00fcf31e-7328-470e-9d7c-042cdd6fe72a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6/action" status: 200 len: 32 microversion: 2.1 time: 0.267916 Jun 27 15:28:11.644834 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 98/200] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:28:11 2022] POST /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6/action => generated 32 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:28:11.662712 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-48992b66-8365-4593-93cb-b5c91f584fb2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:11.668793 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-48992b66-8365-4593-93cb-b5c91f584fb2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:11.692545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48992b66-8365-4593-93cb-b5c91f584fb2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:11.693544 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48992b66-8365-4593-93cb-b5c91f584fb2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:11.708195 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48992b66-8365-4593-93cb-b5c91f584fb2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:11.712804 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48992b66-8365-4593-93cb-b5c91f584fb2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:11.910537 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-65217dae-3ddb-4749-8106-a65136764e9a tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:11.916194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-65217dae-3ddb-4749-8106-a65136764e9a tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:11.941500 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-65217dae-3ddb-4749-8106-a65136764e9a tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:11.942894 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-65217dae-3ddb-4749-8106-a65136764e9a tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:11.945223 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-65217dae-3ddb-4749-8106-a65136764e9a tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:11.947666 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-65217dae-3ddb-4749-8106-a65136764e9a tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:12.458707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-65217dae-3ddb-4749-8106-a65136764e9a tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:12.493940 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-65217dae-3ddb-4749-8106-a65136764e9a tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1313 microversion: 2.1 time: 0.592257 Jun 27 15:28:12.498104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 99/201] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:11 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1313 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:12.512698 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-5ed192c4-07a1-4f17-979b-9e895be2b39b req-d121ad26-351f-4a45-9346-078ffee4f350 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5904f8c3-03a8-480d-9fd1-b1a04297fb89", "tag": "5c0b8c96-7cca-481a-898e-110bd8fd3450"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:12.529638 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-48992b66-8365-4593-93cb-b5c91f584fb2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:12.561251 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-5ed192c4-07a1-4f17-979b-9e895be2b39b req-d121ad26-351f-4a45-9346-078ffee4f350 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:12.561698 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-5ed192c4-07a1-4f17-979b-9e895be2b39b req-d121ad26-351f-4a45-9346-078ffee4f350 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:12.567897 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-48992b66-8365-4593-93cb-b5c91f584fb2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.916475 Jun 27 15:28:12.573150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 103/202] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:11 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:12.607218 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-5ed192c4-07a1-4f17-979b-9e895be2b39b req-d121ad26-351f-4a45-9346-078ffee4f350 service nova] Creating event network-changed:5c0b8c96-7cca-481a-898e-110bd8fd3450 for instance 5904f8c3-03a8-480d-9fd1-b1a04297fb89 on hv-cinder-84779 Jun 27 15:28:12.626267 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-5ed192c4-07a1-4f17-979b-9e895be2b39b req-d121ad26-351f-4a45-9346-078ffee4f350 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125422 Jun 27 15:28:12.630974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 100/203] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:28:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:13.558813 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6e08fc48-a35a-4338-9a95-409d3ef30fa2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:13.565970 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6e08fc48-a35a-4338-9a95-409d3ef30fa2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:13.591421 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-41a5e095-5ff4-4ed9-9b44-3d607ea82558 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:13.592165 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-41a5e095-5ff4-4ed9-9b44-3d607ea82558 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:13.601164 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e08fc48-a35a-4338-9a95-409d3ef30fa2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:13.602876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e08fc48-a35a-4338-9a95-409d3ef30fa2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:13.606935 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e08fc48-a35a-4338-9a95-409d3ef30fa2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:13.607919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41a5e095-5ff4-4ed9-9b44-3d607ea82558 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:13.608146 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e08fc48-a35a-4338-9a95-409d3ef30fa2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:13.612592 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41a5e095-5ff4-4ed9-9b44-3d607ea82558 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:13.613858 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41a5e095-5ff4-4ed9-9b44-3d607ea82558 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:13.614472 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41a5e095-5ff4-4ed9-9b44-3d607ea82558 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:14.078826 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:14.082819 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6e08fc48-a35a-4338-9a95-409d3ef30fa2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:14.101993 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6e08fc48-a35a-4338-9a95-409d3ef30fa2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1313 microversion: 2.1 time: 0.580670 Jun 27 15:28:14.106750 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=6 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:14.135979 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 104/204] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:13 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1313 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:14.189874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-41a5e095-5ff4-4ed9-9b44-3d607ea82558 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:14.202039 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-41a5e095-5ff4-4ed9-9b44-3d607ea82558 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.616118 Jun 27 15:28:14.202974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 101/205] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:13 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:15.148631 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b6a4aa23-284d-4ccd-a92d-a7c7183cdf70 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:15.161492 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b6a4aa23-284d-4ccd-a92d-a7c7183cdf70 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:15.166775 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:15.186985 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b6a4aa23-284d-4ccd-a92d-a7c7183cdf70 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:15.188051 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b6a4aa23-284d-4ccd-a92d-a7c7183cdf70 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:15.189223 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b6a4aa23-284d-4ccd-a92d-a7c7183cdf70 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:15.192030 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b6a4aa23-284d-4ccd-a92d-a7c7183cdf70 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:15.222347 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:15.396899 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fe9231bf-0fbf-49e1-adec-9e86085bd2f7 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: .version_select at 0x7fb2737a2e50>, body: {"keypair": {"name": "tempest-keypair-1267634364", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/nJ37rftdqv/BqPOdrc4Q/ZEkJT2B2UuYoZxS7D1WT8trZeU7/adwae9Y8VEmcp3yWL8iKVxviIQfBwkVbfVl4c0zKYgVvyjFRSoJvUJ0lVpjxNGcTlvmD90Js55yioA=="}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:15.414173 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-fe9231bf-0fbf-49e1-adec-9e86085bd2f7 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for project dff1983b1b3047378b88d87d54aa709d. Resources: {'key_pairs'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:28:15.420364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-fe9231bf-0fbf-49e1-adec-9e86085bd2f7 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for user 23abc809ab644c1da0270a35ac8bab21 and project dff1983b1b3047378b88d87d54aa709d. Resources: {'key_pairs'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:28:15.450734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b6a4aa23-284d-4ccd-a92d-a7c7183cdf70 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:15.454969 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fe9231bf-0fbf-49e1-adec-9e86085bd2f7 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.258019 Jun 27 15:28:15.456859 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 102/206] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jun 27 15:28:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:28:15.465233 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b6a4aa23-284d-4ccd-a92d-a7c7183cdf70 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1313 microversion: 2.1 time: 0.328309 Jun 27 15:28:15.468571 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 105/207] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:15 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1313 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:15.482010 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-60e75ac9-80c4-4c47-8494-2a9d85f19ee3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:15.483565 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-60e75ac9-80c4-4c47-8494-2a9d85f19ee3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:15.503648 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-60e75ac9-80c4-4c47-8494-2a9d85f19ee3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:15.504504 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-60e75ac9-80c4-4c47-8494-2a9d85f19ee3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:15.506114 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-60e75ac9-80c4-4c47-8494-2a9d85f19ee3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:15.507095 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-60e75ac9-80c4-4c47-8494-2a9d85f19ee3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:16.178168 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-60e75ac9-80c4-4c47-8494-2a9d85f19ee3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:16.191809 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-60e75ac9-80c4-4c47-8494-2a9d85f19ee3 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.733530 Jun 27 15:28:16.192447 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 103/208] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:15 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:16.484386 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-203e4cd8-26e8-41dc-953c-e2bdd7161829 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:16.485575 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-203e4cd8-26e8-41dc-953c-e2bdd7161829 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:16.511987 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-203e4cd8-26e8-41dc-953c-e2bdd7161829 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:16.512722 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-203e4cd8-26e8-41dc-953c-e2bdd7161829 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:16.519213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-203e4cd8-26e8-41dc-953c-e2bdd7161829 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:16.519784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-203e4cd8-26e8-41dc-953c-e2bdd7161829 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:16.766974 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-203e4cd8-26e8-41dc-953c-e2bdd7161829 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:16.815735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-203e4cd8-26e8-41dc-953c-e2bdd7161829 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1313 microversion: 2.1 time: 0.330505 Jun 27 15:28:16.828171 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 106/209] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:16 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:17.210235 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3a7a2b59-041b-43b8-bbd2-65133ed2647b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:17.211942 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3a7a2b59-041b-43b8-bbd2-65133ed2647b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:17.219460 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3a7a2b59-041b-43b8-bbd2-65133ed2647b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:17.220523 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3a7a2b59-041b-43b8-bbd2-65133ed2647b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:17.221724 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3a7a2b59-041b-43b8-bbd2-65133ed2647b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:17.222485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3a7a2b59-041b-43b8-bbd2-65133ed2647b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:17.857431 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-66129940-284a-4082-b2ad-10b62fc48969 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:17.857431 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-66129940-284a-4082-b2ad-10b62fc48969 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:17.858298 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66129940-284a-4082-b2ad-10b62fc48969 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:17.859129 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66129940-284a-4082-b2ad-10b62fc48969 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:17.860286 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66129940-284a-4082-b2ad-10b62fc48969 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:17.861315 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-66129940-284a-4082-b2ad-10b62fc48969 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:18.086807 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3a7a2b59-041b-43b8-bbd2-65133ed2647b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:18.092530 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-66129940-284a-4082-b2ad-10b62fc48969 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:18.103438 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-66129940-284a-4082-b2ad-10b62fc48969 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1313 microversion: 2.1 time: 0.262243 Jun 27 15:28:18.104384 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 107/210] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:17 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1313 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:18.110247 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-567d83bc-99f0-4202-87be-0582fa342f6e req-ab8702c5-7787-4556-adcc-8846904e63cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5904f8c3-03a8-480d-9fd1-b1a04297fb89", "name": "network-vif-plugged", "status": "completed", "tag": "5c0b8c96-7cca-481a-898e-110bd8fd3450"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:18.118007 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3a7a2b59-041b-43b8-bbd2-65133ed2647b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.911975 Jun 27 15:28:18.121215 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 104/211] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:17 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:18.121760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-567d83bc-99f0-4202-87be-0582fa342f6e req-ab8702c5-7787-4556-adcc-8846904e63cb service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:18.122399 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-567d83bc-99f0-4202-87be-0582fa342f6e req-ab8702c5-7787-4556-adcc-8846904e63cb service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:18.173526 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-567d83bc-99f0-4202-87be-0582fa342f6e req-ab8702c5-7787-4556-adcc-8846904e63cb service nova] Creating event network-vif-plugged:5c0b8c96-7cca-481a-898e-110bd8fd3450 for instance 5904f8c3-03a8-480d-9fd1-b1a04297fb89 on hv-cinder-84779 Jun 27 15:28:18.192960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-567d83bc-99f0-4202-87be-0582fa342f6e req-ab8702c5-7787-4556-adcc-8846904e63cb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084092 Jun 27 15:28:18.193760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 108/212] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:28:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:19.126113 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fad55d12-cc2a-4e77-b720-76130e9eab24 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:19.127254 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-fad55d12-cc2a-4e77-b720-76130e9eab24 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:19.151058 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e0c4954e-77f9-40a6-bdf5-f7cdfc9b8d78 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:19.151767 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e0c4954e-77f9-40a6-bdf5-f7cdfc9b8d78 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:19.165234 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fad55d12-cc2a-4e77-b720-76130e9eab24 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:19.166447 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fad55d12-cc2a-4e77-b720-76130e9eab24 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:19.170447 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fad55d12-cc2a-4e77-b720-76130e9eab24 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:19.173978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fad55d12-cc2a-4e77-b720-76130e9eab24 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:19.179810 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e0c4954e-77f9-40a6-bdf5-f7cdfc9b8d78 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:19.180573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e0c4954e-77f9-40a6-bdf5-f7cdfc9b8d78 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:19.182477 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e0c4954e-77f9-40a6-bdf5-f7cdfc9b8d78 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:19.184859 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e0c4954e-77f9-40a6-bdf5-f7cdfc9b8d78 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:19.254035 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:19.560551 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e0c4954e-77f9-40a6-bdf5-f7cdfc9b8d78 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:19.570723 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e0c4954e-77f9-40a6-bdf5-f7cdfc9b8d78 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.425020 Jun 27 15:28:19.571317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 109/213] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:19 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:19.658869 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fad55d12-cc2a-4e77-b720-76130e9eab24 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:19.667129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fad55d12-cc2a-4e77-b720-76130e9eab24 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1313 microversion: 2.1 time: 0.544991 Jun 27 15:28:19.679112 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 105/214] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:19 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1313 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:20.175514 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-471175669", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f2b3a5f-8943-48e2-bb0f-3f837d61206a"}], "security_groups": [{"name": "tempest-securitygroup--1955102614"}], "key_name": "tempest-keypair-1267634364", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:20.554021 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] validate_networks() for [('9f2b3a5f-8943-48e2-bb0f-3f837d61206a', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:28:20.588183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e47a0167-df06-4e40-969e-2da742c76780 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:20.589095 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e47a0167-df06-4e40-969e-2da742c76780 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:20.612486 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e47a0167-df06-4e40-969e-2da742c76780 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:20.612944 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e47a0167-df06-4e40-969e-2da742c76780 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:20.613886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e47a0167-df06-4e40-969e-2da742c76780 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:20.620223 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e47a0167-df06-4e40-969e-2da742c76780 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:21.116372 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e47a0167-df06-4e40-969e-2da742c76780 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:21.127771 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e47a0167-df06-4e40-969e-2da742c76780 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.542422 Jun 27 15:28:21.129587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 106/215] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:20 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:21.142621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-702bcf08-5c11-49ff-ae2e-63bcde6752fe tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:21.149372 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-702bcf08-5c11-49ff-ae2e-63bcde6752fe tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:21.170902 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-702bcf08-5c11-49ff-ae2e-63bcde6752fe tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:21.176049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-702bcf08-5c11-49ff-ae2e-63bcde6752fe tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:21.177237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-702bcf08-5c11-49ff-ae2e-63bcde6752fe tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:21.177852 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-702bcf08-5c11-49ff-ae2e-63bcde6752fe tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:21.545463 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-702bcf08-5c11-49ff-ae2e-63bcde6752fe tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:21.567977 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-702bcf08-5c11-49ff-ae2e-63bcde6752fe tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1498 microversion: 2.1 time: 0.435387 Jun 27 15:28:21.571265 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 107/216] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:21 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1498 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:21.734189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:28:21.735954 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:28:21.736706 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:28:21.737786 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:28:21.738652 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:28:21.765127 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:21.765584 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:21.777490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:21.780637 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:21.907400 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for project dff1983b1b3047378b88d87d54aa709d. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:28:21.937604 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for user 23abc809ab644c1da0270a35ac8bab21 and project dff1983b1b3047378b88d87d54aa709d. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:28:22.019474 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:28:22.037561 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:28:22.150098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3e1c70cf-fd1c-46dc-a720-41fdc3e0d56c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:22.150879 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3e1c70cf-fd1c-46dc-a720-41fdc3e0d56c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:22.178118 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e10d93f0-9f69-4e42-bb3b-67259b8a555f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.005965 Jun 27 15:28:22.185744 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 110/217] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:28:20 2022] POST /compute/v2.1/servers => generated 402 bytes in 2016 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:28:22.195269 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5cc32906-b708-478b-bf83-0dfd27edd3f9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:22.200459 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3e1c70cf-fd1c-46dc-a720-41fdc3e0d56c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:22.205852 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5cc32906-b708-478b-bf83-0dfd27edd3f9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:22.227234 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3e1c70cf-fd1c-46dc-a720-41fdc3e0d56c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:22.251287 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3e1c70cf-fd1c-46dc-a720-41fdc3e0d56c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:22.252186 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3e1c70cf-fd1c-46dc-a720-41fdc3e0d56c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:22.339045 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5cc32906-b708-478b-bf83-0dfd27edd3f9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:22.354313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5cc32906-b708-478b-bf83-0dfd27edd3f9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1241 microversion: 2.1 time: 0.166967 Jun 27 15:28:22.355132 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 111/218] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:22 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1241 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:22.411332 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f8a0c9bb-9cf4-47ee-a444-0c19cf66ccbc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:22.412282 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f8a0c9bb-9cf4-47ee-a444-0c19cf66ccbc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:22.419535 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f8a0c9bb-9cf4-47ee-a444-0c19cf66ccbc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:22.422313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f8a0c9bb-9cf4-47ee-a444-0c19cf66ccbc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:22.423813 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f8a0c9bb-9cf4-47ee-a444-0c19cf66ccbc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:22.424486 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f8a0c9bb-9cf4-47ee-a444-0c19cf66ccbc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:22.456894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f8a0c9bb-9cf4-47ee-a444-0c19cf66ccbc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:28:22.643727 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f8a0c9bb-9cf4-47ee-a444-0c19cf66ccbc tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 204 len: 0 microversion: 2.1 time: 0.235337 Jun 27 15:28:22.647062 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 112/219] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:28:22 2022] DELETE /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:28:22.677021 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e0e36dfa-56ca-407d-a8e3-f760bda03510 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:22.687105 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e0e36dfa-56ca-407d-a8e3-f760bda03510 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:22.732129 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e0e36dfa-56ca-407d-a8e3-f760bda03510 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:22.737076 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e0e36dfa-56ca-407d-a8e3-f760bda03510 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:22.737991 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e0e36dfa-56ca-407d-a8e3-f760bda03510 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:22.738479 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e0e36dfa-56ca-407d-a8e3-f760bda03510 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:22.974938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e0e36dfa-56ca-407d-a8e3-f760bda03510 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:22.984985 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e0e36dfa-56ca-407d-a8e3-f760bda03510 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1504 microversion: 2.1 time: 0.330673 Jun 27 15:28:22.998950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 113/220] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:22 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1504 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:23.010305 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3e1c70cf-fd1c-46dc-a720-41fdc3e0d56c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:23.020235 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3e1c70cf-fd1c-46dc-a720-41fdc3e0d56c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.876792 Jun 27 15:28:23.021501 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 108/221] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:22 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 879 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:23.372187 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-48bc6b79-dc9f-4df3-874c-ff6e5f3fa8e6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:23.372829 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-48bc6b79-dc9f-4df3-874c-ff6e5f3fa8e6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:23.386413 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48bc6b79-dc9f-4df3-874c-ff6e5f3fa8e6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:23.386932 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48bc6b79-dc9f-4df3-874c-ff6e5f3fa8e6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:23.390769 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48bc6b79-dc9f-4df3-874c-ff6e5f3fa8e6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:23.391408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48bc6b79-dc9f-4df3-874c-ff6e5f3fa8e6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:23.516576 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-48bc6b79-dc9f-4df3-874c-ff6e5f3fa8e6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:23.533125 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-48bc6b79-dc9f-4df3-874c-ff6e5f3fa8e6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1245 microversion: 2.1 time: 0.162390 Jun 27 15:28:23.533941 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 114/222] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:23 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1245 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:24.010305 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5b588e45-f764-481d-82bb-209a19925833 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:24.013316 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5b588e45-f764-481d-82bb-209a19925833 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:24.043147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-731f1e82-54ef-4660-9cae-7326ec892dcf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:24.045341 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-731f1e82-54ef-4660-9cae-7326ec892dcf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:24.053273 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b588e45-f764-481d-82bb-209a19925833 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:24.054040 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b588e45-f764-481d-82bb-209a19925833 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:24.057988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b588e45-f764-481d-82bb-209a19925833 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:24.058453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-731f1e82-54ef-4660-9cae-7326ec892dcf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:24.058751 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b588e45-f764-481d-82bb-209a19925833 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:24.059840 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-731f1e82-54ef-4660-9cae-7326ec892dcf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:24.061031 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-731f1e82-54ef-4660-9cae-7326ec892dcf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:24.062392 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-731f1e82-54ef-4660-9cae-7326ec892dcf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:24.488377 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b588e45-f764-481d-82bb-209a19925833 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:24.497606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5b588e45-f764-481d-82bb-209a19925833 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1504 microversion: 2.1 time: 0.496589 Jun 27 15:28:24.498963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 109/223] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:23 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1504 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:24.559317 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-503f2435-f03c-4ab0-9875-12044e478eac tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:24.560502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-503f2435-f03c-4ab0-9875-12044e478eac tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:24.573938 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-503f2435-f03c-4ab0-9875-12044e478eac tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:24.575892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-503f2435-f03c-4ab0-9875-12044e478eac tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:24.577935 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-503f2435-f03c-4ab0-9875-12044e478eac tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:24.578700 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-503f2435-f03c-4ab0-9875-12044e478eac tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:24.681711 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-731f1e82-54ef-4660-9cae-7326ec892dcf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:24.709175 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-731f1e82-54ef-4660-9cae-7326ec892dcf tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.673114 Jun 27 15:28:24.709819 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 115/224] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:24 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:25.061159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-503f2435-f03c-4ab0-9875-12044e478eac tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:25.084126 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-503f2435-f03c-4ab0-9875-12044e478eac tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1293 microversion: 2.1 time: 0.537412 Jun 27 15:28:25.089033 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 110/225] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:24 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1293 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:25.382176 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-f6c649e3-0e85-427c-8d19-7f3a2d463d4f req-c951bf15-c1f9-4c60-a803-d61af7f1ad9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5904f8c3-03a8-480d-9fd1-b1a04297fb89", "name": "network-vif-deleted", "tag": "5c0b8c96-7cca-481a-898e-110bd8fd3450"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:25.394840 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f6c649e3-0e85-427c-8d19-7f3a2d463d4f req-c951bf15-c1f9-4c60-a803-d61af7f1ad9a service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:25.395585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f6c649e3-0e85-427c-8d19-7f3a2d463d4f req-c951bf15-c1f9-4c60-a803-d61af7f1ad9a service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:25.420031 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-f6c649e3-0e85-427c-8d19-7f3a2d463d4f req-c951bf15-c1f9-4c60-a803-d61af7f1ad9a service nova] Creating event network-vif-deleted:5c0b8c96-7cca-481a-898e-110bd8fd3450 for instance 5904f8c3-03a8-480d-9fd1-b1a04297fb89 on hv-cinder-84779 Jun 27 15:28:25.435979 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-f6c649e3-0e85-427c-8d19-7f3a2d463d4f req-c951bf15-c1f9-4c60-a803-d61af7f1ad9a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057554 Jun 27 15:28:25.438231 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 116/226] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:28:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:25.515374 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:25.516023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:25.519745 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=4 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:25.524342 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:25.531407 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:25.538383 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:25.539339 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:25.604528 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:25.605373 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:25.607227 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lazy-loading 'fault' on Instance uuid 5904f8c3-03a8-480d-9fd1-b1a04297fb89 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:28:25.722869 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:25.733975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a63c5f09-4874-414d-97dd-1e7304331eef tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:25.734998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-bbcbac65-fdfe-4f5b-8298-c9b2a56c6609 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 200 len: 1303 microversion: 2.1 time: 0.223715 Jun 27 15:28:25.736987 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 111/227] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:25 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 1303 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:25.738811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a63c5f09-4874-414d-97dd-1e7304331eef tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:25.750358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a63c5f09-4874-414d-97dd-1e7304331eef tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:25.751349 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a63c5f09-4874-414d-97dd-1e7304331eef tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:25.753119 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a63c5f09-4874-414d-97dd-1e7304331eef tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:25.757539 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a63c5f09-4874-414d-97dd-1e7304331eef tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:26.106268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-82e82392-dfcf-4c28-b8dc-eee2d29e6e71 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:26.107278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-82e82392-dfcf-4c28-b8dc-eee2d29e6e71 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:26.124802 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-82e82392-dfcf-4c28-b8dc-eee2d29e6e71 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:26.129381 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-82e82392-dfcf-4c28-b8dc-eee2d29e6e71 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:26.130799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-82e82392-dfcf-4c28-b8dc-eee2d29e6e71 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:26.138597 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-82e82392-dfcf-4c28-b8dc-eee2d29e6e71 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:26.315069 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-82e82392-dfcf-4c28-b8dc-eee2d29e6e71 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:26.334539 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-82e82392-dfcf-4c28-b8dc-eee2d29e6e71 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1299 microversion: 2.1 time: 0.232597 Jun 27 15:28:26.336477 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 112/228] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:26 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1299 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:26.458132 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a63c5f09-4874-414d-97dd-1e7304331eef tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:26.493775 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a63c5f09-4874-414d-97dd-1e7304331eef tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.768869 Jun 27 15:28:26.518900 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 117/229] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:25 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:26.757323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-097d8380-5ef0-4ad6-8ca3-44b8b808010b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:26.758796 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-097d8380-5ef0-4ad6-8ca3-44b8b808010b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 5904f8c3-03a8-480d-9fd1-b1a04297fb89] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:26.771255 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-097d8380-5ef0-4ad6-8ca3-44b8b808010b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:26.772053 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-097d8380-5ef0-4ad6-8ca3-44b8b808010b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:26.773540 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-097d8380-5ef0-4ad6-8ca3-44b8b808010b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:26.774314 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-097d8380-5ef0-4ad6-8ca3-44b8b808010b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:26.807799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-097d8380-5ef0-4ad6-8ca3-44b8b808010b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] HTTP exception thrown: Instance 5904f8c3-03a8-480d-9fd1-b1a04297fb89 could not be found. Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-097d8380-5ef0-4ad6-8ca3-44b8b808010b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Request method failure captured: Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 HTTP/1.1 Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucx_MkOUNJ1MRfLOj-G8J4jnZv0MfLOxWyA64RU03HBPL8-1mMdkOnK8UDdseEpWwzmooDOPkgQLjkff500pIgNCOf2Rgf_VfK9nvcwx7exGxdoe1K25cS_Ki70WOjSACC4I_p_oKI4lhf-ATHMj6-9Uw_nMWRO56GWsOgK0nJS5L-c Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: b99a389f8cd34552ae1b3c30803669ae Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesActionsTest-702925784 Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:28:26.811665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99a389f8cd34552ae1b3c30803669ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99a389f8cd34552ae1b3c30803669ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99a389f8cd34552ae1b3c30803669ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99a389f8cd34552ae1b3c30803669ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesActionsTest-702925784 Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: b99a389f8cd34552ae1b3c30803669ae Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesActionsTest-702925784 Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesActionsTest-702925784-project Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: b9d9cb0073b5452698e549792adf6733 Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesActionsTest-702925784-project Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 5904f8c3-03a8-480d-9fd1-b1a04297fb89 could not be found. Jun 27 15:28:26.814585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '5904f8c3-03a8-480d-9fd1-b1a04297fb89'} Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5904f8c3-03a8-480d-9fd1-b1a04297fb89 could not be found. Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:28:26.817043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5904f8c3-03a8-480d-9fd1-b1a04297fb89 could not be found. Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5904f8c3-03a8-480d-9fd1-b1a04297fb89 could not be found. Jun 27 15:28:26.819485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:28:26.821887 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-097d8380-5ef0-4ad6-8ca3-44b8b808010b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Returning 404 to user: Instance 5904f8c3-03a8-480d-9fd1-b1a04297fb89 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:28:26.821887 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-097d8380-5ef0-4ad6-8ca3-44b8b808010b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89" status: 404 len: 111 microversion: 2.1 time: 0.066482 Jun 27 15:28:26.826565 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 113/230] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:26 2022] GET /compute/v2.1/servers/5904f8c3-03a8-480d-9fd1-b1a04297fb89 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:28:27.050805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-384729882", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "networks": [{"uuid": "2579e3bc-4a9d-498c-82ba-b2ed0949972e"}]}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:27.229616 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] validate_networks() for [('2579e3bc-4a9d-498c-82ba-b2ed0949972e', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:28:27.361790 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9b120e3e-d5f3-4b2a-beec-a02e7db246c5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:27.364215 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9b120e3e-d5f3-4b2a-beec-a02e7db246c5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:27.389154 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b120e3e-d5f3-4b2a-beec-a02e7db246c5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:27.390055 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b120e3e-d5f3-4b2a-beec-a02e7db246c5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:27.397061 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b120e3e-d5f3-4b2a-beec-a02e7db246c5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:27.398358 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b120e3e-d5f3-4b2a-beec-a02e7db246c5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:27.680819 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9b120e3e-d5f3-4b2a-beec-a02e7db246c5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:27.691357 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9b120e3e-d5f3-4b2a-beec-a02e7db246c5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1367 microversion: 2.1 time: 0.340402 Jun 27 15:28:27.703245 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 114/231] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:27 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1367 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:27.708731 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3d97b0d4-8cf5-48c1-8565-3b4198c0332b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:27.709370 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3d97b0d4-8cf5-48c1-8565-3b4198c0332b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:27.711424 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=4 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:27.718467 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3d97b0d4-8cf5-48c1-8565-3b4198c0332b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:27.719322 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3d97b0d4-8cf5-48c1-8565-3b4198c0332b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:27.720648 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3d97b0d4-8cf5-48c1-8565-3b4198c0332b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:27.721294 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3d97b0d4-8cf5-48c1-8565-3b4198c0332b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:28.045168 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3d97b0d4-8cf5-48c1-8565-3b4198c0332b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:28.068786 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3d97b0d4-8cf5-48c1-8565-3b4198c0332b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.363692 Jun 27 15:28:28.077584 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 115/232] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:27 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:28.317264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-723262a7-9fbd-48f7-9a2a-c971c50b51a8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:28.318108 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-723262a7-9fbd-48f7-9a2a-c971c50b51a8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:28.329271 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-723262a7-9fbd-48f7-9a2a-c971c50b51a8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:28.330154 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-723262a7-9fbd-48f7-9a2a-c971c50b51a8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:28.330907 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-723262a7-9fbd-48f7-9a2a-c971c50b51a8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:28.331421 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-723262a7-9fbd-48f7-9a2a-c971c50b51a8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:28.361542 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-723262a7-9fbd-48f7-9a2a-c971c50b51a8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/ips" status: 200 len: 152 microversion: 2.20 time: 0.049653 Jun 27 15:28:28.362522 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 116/233] 10.222.0.26 () {60 vars in 1288 bytes} [Mon Jun 27 15:28:28 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/ips => generated 152 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:28:28.716509 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-59cca190-1141-4592-94f1-def585fe1281 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:28.717360 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-59cca190-1141-4592-94f1-def585fe1281 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:28.746347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-59cca190-1141-4592-94f1-def585fe1281 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:28.747215 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-59cca190-1141-4592-94f1-def585fe1281 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:28.748912 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-59cca190-1141-4592-94f1-def585fe1281 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:28.750506 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-59cca190-1141-4592-94f1-def585fe1281 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:28.989909 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-59cca190-1141-4592-94f1-def585fe1281 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:28.999860 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-59cca190-1141-4592-94f1-def585fe1281 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1367 microversion: 2.1 time: 0.291973 Jun 27 15:28:29.001191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 117/234] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:28 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1367 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:29.007924 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-499a6efc-735f-4765-adb3-0f237971961c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:29.008534 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-499a6efc-735f-4765-adb3-0f237971961c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:29.015914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-499a6efc-735f-4765-adb3-0f237971961c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:29.016471 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-499a6efc-735f-4765-adb3-0f237971961c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:29.017611 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-499a6efc-735f-4765-adb3-0f237971961c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:29.019176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-499a6efc-735f-4765-adb3-0f237971961c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:29.029622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:28:29.030734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:28:29.031417 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:28:29.032086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:28:29.032802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:28:29.051146 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:29.051864 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:29.055806 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:29.056908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:29.086267 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-499a6efc-735f-4765-adb3-0f237971961c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/ips" status: 200 len: 145 microversion: 2.1 time: 0.083366 Jun 27 15:28:29.093830 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 118/235] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jun 27 15:28:29 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/ips => generated 145 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:29.108827 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-92d337d4-073f-4fe0-bdd4-855c7aad63d9 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:29.111524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Getting quotas for project b99a389f8cd34552ae1b3c30803669ae. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:28:29.112793 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-92d337d4-073f-4fe0-bdd4-855c7aad63d9 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:29.122666 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Getting quotas for user b9d9cb0073b5452698e549792adf6733 and project b99a389f8cd34552ae1b3c30803669ae. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:28:29.125688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-92d337d4-073f-4fe0-bdd4-855c7aad63d9 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:29.128536 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-92d337d4-073f-4fe0-bdd4-855c7aad63d9 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:29.129674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-92d337d4-073f-4fe0-bdd4-855c7aad63d9 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:29.131942 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-92d337d4-073f-4fe0-bdd4-855c7aad63d9 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:29.163762 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:28:29.169399 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:28:29.256922 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ac6859f3-ffc1-42bc-a513-362066c804f9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.210806 Jun 27 15:28:29.258125 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 118/236] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:28:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 2213 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:28:29.277729 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-795c7bd5-7d2f-4252-ac99-e29ee40f542f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:29.283915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-795c7bd5-7d2f-4252-ac99-e29ee40f542f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:29.402444 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-92d337d4-073f-4fe0-bdd4-855c7aad63d9 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:29.421213 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-92d337d4-073f-4fe0-bdd4-855c7aad63d9 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.323467 Jun 27 15:28:29.422260 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 119/237] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:29 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:29.580638 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-795c7bd5-7d2f-4252-ac99-e29ee40f542f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:29.600646 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-795c7bd5-7d2f-4252-ac99-e29ee40f542f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1213 microversion: 2.1 time: 0.335869 Jun 27 15:28:29.613857 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 119/238] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:29 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1213 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:30.030204 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c043ed9c-7b9d-4183-8fce-00a33366be9c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:30.034044 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-c043ed9c-7b9d-4183-8fce-00a33366be9c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:30.049471 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c043ed9c-7b9d-4183-8fce-00a33366be9c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:30.050756 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c043ed9c-7b9d-4183-8fce-00a33366be9c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:30.054652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c043ed9c-7b9d-4183-8fce-00a33366be9c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:30.055845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c043ed9c-7b9d-4183-8fce-00a33366be9c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:30.177182 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-d2598d5c-6b69-4b49-b6d3-800396f30b26 req-85b2e4de-eeee-404c-8618-957f8b493b23 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598844cf-f73b-4630-ad12-f08ab67e89e3", "tag": "209e6ff3-398f-4386-b25b-aef36d5f7e9c"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:30.294551 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d2598d5c-6b69-4b49-b6d3-800396f30b26 req-85b2e4de-eeee-404c-8618-957f8b493b23 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:30.297841 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d2598d5c-6b69-4b49-b6d3-800396f30b26 req-85b2e4de-eeee-404c-8618-957f8b493b23 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:30.360576 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-d2598d5c-6b69-4b49-b6d3-800396f30b26 req-85b2e4de-eeee-404c-8618-957f8b493b23 service nova] Creating event network-changed:209e6ff3-398f-4386-b25b-aef36d5f7e9c for instance 598844cf-f73b-4630-ad12-f08ab67e89e3 on hv-cinder-84779 Jun 27 15:28:30.382910 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-d2598d5c-6b69-4b49-b6d3-800396f30b26 req-85b2e4de-eeee-404c-8618-957f8b493b23 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.215089 Jun 27 15:28:30.386606 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 120/239] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:28:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:30.454186 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2f7e6875-a287-4ed4-936c-0355140399d7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:30.455661 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2f7e6875-a287-4ed4-936c-0355140399d7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:30.458886 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:30.479592 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2f7e6875-a287-4ed4-936c-0355140399d7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:30.482893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2f7e6875-a287-4ed4-936c-0355140399d7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:30.484062 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2f7e6875-a287-4ed4-936c-0355140399d7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:30.493664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2f7e6875-a287-4ed4-936c-0355140399d7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:30.571285 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-c043ed9c-7b9d-4183-8fce-00a33366be9c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:30.588852 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c043ed9c-7b9d-4183-8fce-00a33366be9c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1367 microversion: 2.1 time: 0.571242 Jun 27 15:28:30.591005 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 120/240] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:30 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1367 bytes in 575 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:30.623406 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e35093da-70a7-4ff9-9c47-a4406cb38de9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:30.628835 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e35093da-70a7-4ff9-9c47-a4406cb38de9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:30.648611 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e35093da-70a7-4ff9-9c47-a4406cb38de9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:30.649689 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e35093da-70a7-4ff9-9c47-a4406cb38de9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:30.651391 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e35093da-70a7-4ff9-9c47-a4406cb38de9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:30.653473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e35093da-70a7-4ff9-9c47-a4406cb38de9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:30.824655 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e35093da-70a7-4ff9-9c47-a4406cb38de9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:30.844385 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e35093da-70a7-4ff9-9c47-a4406cb38de9 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1265 microversion: 2.1 time: 0.228656 Jun 27 15:28:30.846532 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 121/241] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:30 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:30.864376 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4ed64c6e-e33c-465d-9356-c3d630d7cb49 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:30.871159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4ed64c6e-e33c-465d-9356-c3d630d7cb49 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:30.892859 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4ed64c6e-e33c-465d-9356-c3d630d7cb49 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:30.893308 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4ed64c6e-e33c-465d-9356-c3d630d7cb49 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:30.901228 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4ed64c6e-e33c-465d-9356-c3d630d7cb49 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:30.902219 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4ed64c6e-e33c-465d-9356-c3d630d7cb49 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:30.971719 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-4ed64c6e-e33c-465d-9356-c3d630d7cb49 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lazy-loading 'flavor' on Instance uuid 831291d0-f04d-4927-afcd-88fd058db642 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:28:31.007418 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=100 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:31.357736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2f7e6875-a287-4ed4-936c-0355140399d7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:31.400351 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2f7e6875-a287-4ed4-936c-0355140399d7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.953468 Jun 27 15:28:31.417139 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 121/242] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:30 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 971 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:31.557747 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4ed64c6e-e33c-465d-9356-c3d630d7cb49 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "POST /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/action" status: 202 len: 0 microversion: 2.20 time: 0.709222 Jun 27 15:28:31.559567 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 122/243] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jun 27 15:28:30 2022] POST /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/action => generated 0 bytes in 712 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:28:31.574566 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e266fa67-6309-47f5-8890-ec8fdfc9be28 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:31.576090 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e266fa67-6309-47f5-8890-ec8fdfc9be28 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:31.589550 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e266fa67-6309-47f5-8890-ec8fdfc9be28 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:31.591091 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e266fa67-6309-47f5-8890-ec8fdfc9be28 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:31.593319 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e266fa67-6309-47f5-8890-ec8fdfc9be28 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:31.599512 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e266fa67-6309-47f5-8890-ec8fdfc9be28 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:31.625678 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f495cd62-ca0c-4d2d-a3a0-9f98463298c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:31.627036 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f495cd62-ca0c-4d2d-a3a0-9f98463298c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:31.650467 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f495cd62-ca0c-4d2d-a3a0-9f98463298c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:31.650928 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f495cd62-ca0c-4d2d-a3a0-9f98463298c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:31.655371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f495cd62-ca0c-4d2d-a3a0-9f98463298c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:31.657975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f495cd62-ca0c-4d2d-a3a0-9f98463298c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:32.032660 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f495cd62-ca0c-4d2d-a3a0-9f98463298c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:32.060457 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f495cd62-ca0c-4d2d-a3a0-9f98463298c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1367 microversion: 2.1 time: 0.440357 Jun 27 15:28:32.063724 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 123/244] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:31 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1367 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:32.098646 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ecd38004-b1fe-44af-9acf-c36b2b586e83 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:32.102227 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ecd38004-b1fe-44af-9acf-c36b2b586e83 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:32.114304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ecd38004-b1fe-44af-9acf-c36b2b586e83 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:32.114763 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ecd38004-b1fe-44af-9acf-c36b2b586e83 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:32.115737 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ecd38004-b1fe-44af-9acf-c36b2b586e83 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:32.115992 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ecd38004-b1fe-44af-9acf-c36b2b586e83 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:32.124043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e266fa67-6309-47f5-8890-ec8fdfc9be28 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:32.146321 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e266fa67-6309-47f5-8890-ec8fdfc9be28 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:32.150945 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e266fa67-6309-47f5-8890-ec8fdfc9be28 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:32.154361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e266fa67-6309-47f5-8890-ec8fdfc9be28 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.586640 Jun 27 15:28:32.155955 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 122/245] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:31 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:32.167862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bacbec84-1df2-48c4-8232-568ad3f23b3a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56ab45a8-e880-47ca-a641-a199275822d2"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:32.172689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bacbec84-1df2-48c4-8232-568ad3f23b3a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:32.189045 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bacbec84-1df2-48c4-8232-568ad3f23b3a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:32.193430 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bacbec84-1df2-48c4-8232-568ad3f23b3a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:32.197295 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bacbec84-1df2-48c4-8232-568ad3f23b3a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:32.197753 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bacbec84-1df2-48c4-8232-568ad3f23b3a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:32.286925 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ecd38004-b1fe-44af-9acf-c36b2b586e83 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:32.305334 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ecd38004-b1fe-44af-9acf-c36b2b586e83 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1271 microversion: 2.1 time: 0.238092 Jun 27 15:28:32.310904 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 124/246] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:32 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1271 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:32.427258 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-58beb17e-432e-4d39-a5c2-aee6c96942a4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:32.428176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-58beb17e-432e-4d39-a5c2-aee6c96942a4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:32.442303 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-58beb17e-432e-4d39-a5c2-aee6c96942a4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:32.443083 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-58beb17e-432e-4d39-a5c2-aee6c96942a4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:32.444243 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-58beb17e-432e-4d39-a5c2-aee6c96942a4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:32.444836 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-58beb17e-432e-4d39-a5c2-aee6c96942a4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:32.662520 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-58beb17e-432e-4d39-a5c2-aee6c96942a4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:32.677494 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-58beb17e-432e-4d39-a5c2-aee6c96942a4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.253904 Jun 27 15:28:32.689820 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 125/247] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:32 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:33.091634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9b6095ba-ac39-428e-b6d5-2febb108e7c3 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:33.092812 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9b6095ba-ac39-428e-b6d5-2febb108e7c3 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:33.106237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b6095ba-ac39-428e-b6d5-2febb108e7c3 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:33.107111 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b6095ba-ac39-428e-b6d5-2febb108e7c3 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:33.109710 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b6095ba-ac39-428e-b6d5-2febb108e7c3 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:33.113640 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b6095ba-ac39-428e-b6d5-2febb108e7c3 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:33.461603 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bacbec84-1df2-48c4-8232-568ad3f23b3a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.302649 Jun 27 15:28:33.464764 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 123/248] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:28:32 2022] POST /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/os-volume_attachments => generated 194 bytes in 1308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:33.489929 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-868d3ae1-363c-40cf-bffb-84bba7912250 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:33.497474 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-868d3ae1-363c-40cf-bffb-84bba7912250 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:33.531369 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9b6095ba-ac39-428e-b6d5-2febb108e7c3 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:33.543124 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9b6095ba-ac39-428e-b6d5-2febb108e7c3 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1367 microversion: 2.1 time: 0.455632 Jun 27 15:28:33.543124 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 126/249] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:33 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1367 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:33.550733 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-868d3ae1-363c-40cf-bffb-84bba7912250 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:33.551309 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e63d89f3-dab6-40f5-94d5-a3e6ba3a6586 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:33.551726 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-868d3ae1-363c-40cf-bffb-84bba7912250 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:33.552023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e63d89f3-dab6-40f5-94d5-a3e6ba3a6586 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:33.557915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-868d3ae1-363c-40cf-bffb-84bba7912250 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:33.558404 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-868d3ae1-363c-40cf-bffb-84bba7912250 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:33.559250 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e63d89f3-dab6-40f5-94d5-a3e6ba3a6586 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:33.559713 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e63d89f3-dab6-40f5-94d5-a3e6ba3a6586 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:33.560540 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e63d89f3-dab6-40f5-94d5-a3e6ba3a6586 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:33.560987 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e63d89f3-dab6-40f5-94d5-a3e6ba3a6586 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:33.649544 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:34.023974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e63d89f3-dab6-40f5-94d5-a3e6ba3a6586 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:34.036849 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e63d89f3-dab6-40f5-94d5-a3e6ba3a6586 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1313 microversion: 2.1 time: 0.493856 Jun 27 15:28:34.040088 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 127/250] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:33 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1313 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:34.058178 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-62ef9932-e5f4-4b15-98cc-973ff86a399b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:34.059580 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-62ef9932-e5f4-4b15-98cc-973ff86a399b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:34.068996 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-62ef9932-e5f4-4b15-98cc-973ff86a399b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:34.076287 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-62ef9932-e5f4-4b15-98cc-973ff86a399b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:34.077622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-62ef9932-e5f4-4b15-98cc-973ff86a399b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:34.080143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-62ef9932-e5f4-4b15-98cc-973ff86a399b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:34.239238 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-868d3ae1-363c-40cf-bffb-84bba7912250 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:34.257872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-868d3ae1-363c-40cf-bffb-84bba7912250 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:34.261618 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-868d3ae1-363c-40cf-bffb-84bba7912250 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:34.263738 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-868d3ae1-363c-40cf-bffb-84bba7912250 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.796275 Jun 27 15:28:34.265103 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 124/251] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:33 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 800 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:34.464775 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-62ef9932-e5f4-4b15-98cc-973ff86a399b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:34.510144 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-62ef9932-e5f4-4b15-98cc-973ff86a399b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.453344 Jun 27 15:28:34.518291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 128/252] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:34 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:34.578273 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-31de3723-71a1-4a53-b6f2-3f4aa54ddb3b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:34.582390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-31de3723-71a1-4a53-b6f2-3f4aa54ddb3b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:34.614547 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31de3723-71a1-4a53-b6f2-3f4aa54ddb3b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:34.624581 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31de3723-71a1-4a53-b6f2-3f4aa54ddb3b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:34.627191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31de3723-71a1-4a53-b6f2-3f4aa54ddb3b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:34.643818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31de3723-71a1-4a53-b6f2-3f4aa54ddb3b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:35.070735 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-798e0c3c-db09-407f-8a33-3de76d5184b7 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:35.078062 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-798e0c3c-db09-407f-8a33-3de76d5184b7 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:35.124570 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-798e0c3c-db09-407f-8a33-3de76d5184b7 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:35.125800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-798e0c3c-db09-407f-8a33-3de76d5184b7 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:35.127662 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-798e0c3c-db09-407f-8a33-3de76d5184b7 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:35.130049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-798e0c3c-db09-407f-8a33-3de76d5184b7 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:35.199891 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-31de3723-71a1-4a53-b6f2-3f4aa54ddb3b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:35.221502 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-31de3723-71a1-4a53-b6f2-3f4aa54ddb3b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1367 microversion: 2.1 time: 0.649987 Jun 27 15:28:35.222176 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 125/253] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:34 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1367 bytes in 652 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:35.291845 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2a039327-f004-4cd0-96d4-b93ce7563382 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:35.295170 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2a039327-f004-4cd0-96d4-b93ce7563382 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:35.323840 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a039327-f004-4cd0-96d4-b93ce7563382 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:35.325355 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a039327-f004-4cd0-96d4-b93ce7563382 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:35.334349 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a039327-f004-4cd0-96d4-b93ce7563382 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:35.337577 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a039327-f004-4cd0-96d4-b93ce7563382 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:35.931026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-798e0c3c-db09-407f-8a33-3de76d5184b7 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:35.972714 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-798e0c3c-db09-407f-8a33-3de76d5184b7 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1313 microversion: 2.1 time: 0.905257 Jun 27 15:28:35.974259 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 129/254] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:35 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1313 bytes in 920 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:35.991262 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-03f888d7-7e10-4d63-9d61-74ec1f7cc594 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:35.992822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-03f888d7-7e10-4d63-9d61-74ec1f7cc594 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:36.021222 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03f888d7-7e10-4d63-9d61-74ec1f7cc594 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:36.022076 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03f888d7-7e10-4d63-9d61-74ec1f7cc594 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:36.023572 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03f888d7-7e10-4d63-9d61-74ec1f7cc594 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:36.024520 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03f888d7-7e10-4d63-9d61-74ec1f7cc594 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:36.379631 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2a039327-f004-4cd0-96d4-b93ce7563382 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:36.422289 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2a039327-f004-4cd0-96d4-b93ce7563382 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:36.429897 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2a039327-f004-4cd0-96d4-b93ce7563382 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:36.432206 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2a039327-f004-4cd0-96d4-b93ce7563382 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 1.147864 Jun 27 15:28:36.435049 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 126/255] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:35 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 1152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:36.450898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-17251077-a3c7-45e7-80e2-de28062b784d req-62a85ebd-80ff-46d6-bdee-795cd71ae4de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "42a451d5-56c8-46fc-914e-2b990c2bd155", "tag": "ea4ab95e-cf94-42bd-ab76-851264e40c78"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:36.484066 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-17251077-a3c7-45e7-80e2-de28062b784d req-62a85ebd-80ff-46d6-bdee-795cd71ae4de service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:36.488497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-17251077-a3c7-45e7-80e2-de28062b784d req-62a85ebd-80ff-46d6-bdee-795cd71ae4de service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:36.550845 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-17251077-a3c7-45e7-80e2-de28062b784d req-62a85ebd-80ff-46d6-bdee-795cd71ae4de service nova] Creating event network-changed:ea4ab95e-cf94-42bd-ab76-851264e40c78 for instance 42a451d5-56c8-46fc-914e-2b990c2bd155 on hv-cinder-84779 Jun 27 15:28:36.585483 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-17251077-a3c7-45e7-80e2-de28062b784d req-62a85ebd-80ff-46d6-bdee-795cd71ae4de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.148229 Jun 27 15:28:36.593313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 127/256] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:28:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:36.611778 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7a50d975-e442-4614-b487-97fd246fb512 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:36.614377 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7a50d975-e442-4614-b487-97fd246fb512 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:36.636813 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a50d975-e442-4614-b487-97fd246fb512 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:36.638017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a50d975-e442-4614-b487-97fd246fb512 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:36.639721 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-03f888d7-7e10-4d63-9d61-74ec1f7cc594 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:36.644292 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a50d975-e442-4614-b487-97fd246fb512 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:36.645656 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a50d975-e442-4614-b487-97fd246fb512 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:36.669801 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-03f888d7-7e10-4d63-9d61-74ec1f7cc594 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.693344 Jun 27 15:28:36.693918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 130/257] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:35 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:37.012105 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d9877a8d-1bbc-4599-b2dd-fa1567d0f6e1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:37.015091 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d9877a8d-1bbc-4599-b2dd-fa1567d0f6e1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:37.064199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d9877a8d-1bbc-4599-b2dd-fa1567d0f6e1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:37.070572 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d9877a8d-1bbc-4599-b2dd-fa1567d0f6e1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:37.073576 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d9877a8d-1bbc-4599-b2dd-fa1567d0f6e1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:37.078952 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d9877a8d-1bbc-4599-b2dd-fa1567d0f6e1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:37.214366 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7a50d975-e442-4614-b487-97fd246fb512 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:37.227539 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7a50d975-e442-4614-b487-97fd246fb512 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1367 microversion: 2.1 time: 0.630969 Jun 27 15:28:37.228978 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 128/258] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:36 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1367 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:37.494946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-60189a8a-24e2-4e40-bc4d-254d5c54df1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:37.498825 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-60189a8a-24e2-4e40-bc4d-254d5c54df1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:37.512657 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d9877a8d-1bbc-4599-b2dd-fa1567d0f6e1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:37.545929 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-60189a8a-24e2-4e40-bc4d-254d5c54df1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:37.549999 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-60189a8a-24e2-4e40-bc4d-254d5c54df1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:37.554957 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-60189a8a-24e2-4e40-bc4d-254d5c54df1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:37.561561 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-60189a8a-24e2-4e40-bc4d-254d5c54df1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:37.581346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d9877a8d-1bbc-4599-b2dd-fa1567d0f6e1 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1313 microversion: 2.1 time: 0.583834 Jun 27 15:28:37.584694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 131/259] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:36 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1313 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:37.708981 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a63d1132-b6ed-4b7f-84da-4e7f321c63bc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:37.719865 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a63d1132-b6ed-4b7f-84da-4e7f321c63bc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:37.790018 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a63d1132-b6ed-4b7f-84da-4e7f321c63bc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:37.817824 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a63d1132-b6ed-4b7f-84da-4e7f321c63bc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:37.819665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a63d1132-b6ed-4b7f-84da-4e7f321c63bc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:37.825514 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a63d1132-b6ed-4b7f-84da-4e7f321c63bc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:37.942809 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-60189a8a-24e2-4e40-bc4d-254d5c54df1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:37.956972 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-60189a8a-24e2-4e40-bc4d-254d5c54df1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:37.959702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-60189a8a-24e2-4e40-bc4d-254d5c54df1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:37.961450 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-60189a8a-24e2-4e40-bc4d-254d5c54df1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.495357 Jun 27 15:28:37.962874 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 129/260] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:37 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:38.004290 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-7ea8855a-ecac-4818-b49f-18516d1e2ce6 req-9b15a2a1-fa03-47f6-8057-83b1bcb8ec31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598844cf-f73b-4630-ad12-f08ab67e89e3", "name": "network-vif-plugged", "status": "completed", "tag": "209e6ff3-398f-4386-b25b-aef36d5f7e9c"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:38.055183 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-7ea8855a-ecac-4818-b49f-18516d1e2ce6 req-9b15a2a1-fa03-47f6-8057-83b1bcb8ec31 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.055924 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-7ea8855a-ecac-4818-b49f-18516d1e2ce6 req-9b15a2a1-fa03-47f6-8057-83b1bcb8ec31 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:38.109656 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-7ea8855a-ecac-4818-b49f-18516d1e2ce6 req-9b15a2a1-fa03-47f6-8057-83b1bcb8ec31 service nova] Creating event network-vif-plugged:209e6ff3-398f-4386-b25b-aef36d5f7e9c for instance 598844cf-f73b-4630-ad12-f08ab67e89e3 on hv-cinder-84779 Jun 27 15:28:38.136734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-7ea8855a-ecac-4818-b49f-18516d1e2ce6 req-9b15a2a1-fa03-47f6-8057-83b1bcb8ec31 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136827 Jun 27 15:28:38.138259 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 130/261] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:28:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:38.227200 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a63d1132-b6ed-4b7f-84da-4e7f321c63bc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:38.247229 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bd22c5ee-265b-4d30-bd81-ff8c512da2e4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:38.248266 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bd22c5ee-265b-4d30-bd81-ff8c512da2e4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:38.263923 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bd22c5ee-265b-4d30-bd81-ff8c512da2e4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.265500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bd22c5ee-265b-4d30-bd81-ff8c512da2e4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:38.265707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a63d1132-b6ed-4b7f-84da-4e7f321c63bc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1502 microversion: 2.1 time: 0.562225 Jun 27 15:28:38.268618 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 132/262] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:37 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1502 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:38.269753 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bd22c5ee-265b-4d30-bd81-ff8c512da2e4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.270555 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bd22c5ee-265b-4d30-bd81-ff8c512da2e4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:38.301334 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1f5ca236-d443-455c-8142-db59cccbe5de tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ebb1e29-a213-49d5-9442-7a223a85d3ae"}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:38.304416 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-1f5ca236-d443-455c-8142-db59cccbe5de tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:38.363544 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1f5ca236-d443-455c-8142-db59cccbe5de tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.365783 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1f5ca236-d443-455c-8142-db59cccbe5de tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:38.367277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1f5ca236-d443-455c-8142-db59cccbe5de tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.369404 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1f5ca236-d443-455c-8142-db59cccbe5de tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:38.435882 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-1f5ca236-d443-455c-8142-db59cccbe5de tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] HTTP exception thrown: Cannot 'attach_volume' instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 while it is in vm_state rescued Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1f5ca236-d443-455c-8142-db59cccbe5de tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Request method failure captured: Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: POST /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6/os-volume_attachments HTTP/1.1 Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 74 Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwoSnYhPWU8-WWSH7wGBafQXIjG8xq98RxBC5ln0qY8NkV2iLRGT08tr0ASJ32aKDac2AetAJt5KEH-MB45B6tNlCKvzjpp2VxDDEmGGD9f2DWMJUawGMuLpCecS5Sr5leKkWGj1HDRn5lcOcvOa-_F1S9KTpDSmAaKp-xUVFJjM6g Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 2832173587a6494eb7f73b3ca0a09a0f Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:28:38.443191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2832173587a6494eb7f73b3ca0a09a0f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 2832173587a6494eb7f73b3ca0a09a0f Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-ServerRescueNegativeTestJSON-640731549-project Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: effe0200dc584f11923e83ed240138ff Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-ServerRescueNegativeTestJSON-640731549-project Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {"volumeAttachment": {"volumeId": "8ebb1e29-a213-49d5-9442-7a223a85d3ae"}} Jun 27 15:28:38.444919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Cannot 'attach_volume' instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 while it is in vm_state rescued Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'server_id': '7aa7f3fe-5f45-46ca-960d-1c77079dceb6', 'body': {'volumeAttachment': {'volumeId': '8ebb1e29-a213-49d5-9442-7a223a85d3ae'}}} Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:28:38.445861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 while it is in vm_state rescued Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:28:38.447290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:28:38.449652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:28:38.449652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:28:38.449652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 while it is in vm_state rescued Jun 27 15:28:38.449652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:28:38.450972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1f5ca236-d443-455c-8142-db59cccbe5de tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Returning 409 to user: Cannot 'attach_volume' instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 while it is in vm_state rescued {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:28:38.452229 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-1f5ca236-d443-455c-8142-db59cccbe5de tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.158861 Jun 27 15:28:38.456209 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 133/263] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:28:38 2022] POST /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6/os-volume_attachments => generated 152 bytes in 164 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 27 15:28:38.468477 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-221ed4df-4b34-430a-ab5e-735373e3e545 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:38.469007 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-221ed4df-4b34-430a-ab5e-735373e3e545 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:38.500912 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-221ed4df-4b34-430a-ab5e-735373e3e545 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.504859 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-221ed4df-4b34-430a-ab5e-735373e3e545 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:38.506968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-221ed4df-4b34-430a-ab5e-735373e3e545 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.507620 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-221ed4df-4b34-430a-ab5e-735373e3e545 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:38.619926 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bd22c5ee-265b-4d30-bd81-ff8c512da2e4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:38.634322 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bd22c5ee-265b-4d30-bd81-ff8c512da2e4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1367 microversion: 2.1 time: 0.391032 Jun 27 15:28:38.634999 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 131/264] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:38 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1367 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:38.658825 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-09f9468b-2923-4d2c-a72c-3185e0f28a93 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:38.660186 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-221ed4df-4b34-430a-ab5e-735373e3e545 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6/action" status: 202 len: 0 microversion: 2.1 time: 0.198146 Jun 27 15:28:38.661785 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-09f9468b-2923-4d2c-a72c-3185e0f28a93 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:38.662512 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 134/265] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:28:38 2022] POST /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:28:38.674852 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-86c381d5-9664-4168-96f5-f7b30e0a9f8a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:38.675988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-86c381d5-9664-4168-96f5-f7b30e0a9f8a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:38.687578 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-86c381d5-9664-4168-96f5-f7b30e0a9f8a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.688722 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-86c381d5-9664-4168-96f5-f7b30e0a9f8a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:38.691037 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-86c381d5-9664-4168-96f5-f7b30e0a9f8a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.692925 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-86c381d5-9664-4168-96f5-f7b30e0a9f8a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:38.699009 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09f9468b-2923-4d2c-a72c-3185e0f28a93 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.700968 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09f9468b-2923-4d2c-a72c-3185e0f28a93 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:38.704582 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09f9468b-2923-4d2c-a72c-3185e0f28a93 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:38.706610 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-09f9468b-2923-4d2c-a72c-3185e0f28a93 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:39.088806 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:39.562629 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-09f9468b-2923-4d2c-a72c-3185e0f28a93 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:39.596528 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=16 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:39.599319 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-09f9468b-2923-4d2c-a72c-3185e0f28a93 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1313 microversion: 2.1 time: 0.951497 Jun 27 15:28:39.602559 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 132/266] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:38 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1313 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:39.619065 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-468ac90f-975d-44eb-a958-168f0205c298 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:39.635154 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-468ac90f-975d-44eb-a958-168f0205c298 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:39.653975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-468ac90f-975d-44eb-a958-168f0205c298 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:39.658156 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-468ac90f-975d-44eb-a958-168f0205c298 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:39.664450 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-468ac90f-975d-44eb-a958-168f0205c298 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:39.665504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-468ac90f-975d-44eb-a958-168f0205c298 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:39.991001 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-86c381d5-9664-4168-96f5-f7b30e0a9f8a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:40.028039 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-86c381d5-9664-4168-96f5-f7b30e0a9f8a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1510 microversion: 2.1 time: 1.359071 Jun 27 15:28:40.029058 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 135/267] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:38 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1510 bytes in 1362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:40.062826 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4c8b4a0b-551e-4a18-8571-aac363dd0095 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:40.066054 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4c8b4a0b-551e-4a18-8571-aac363dd0095 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:40.115438 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4c8b4a0b-551e-4a18-8571-aac363dd0095 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:40.116244 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4c8b4a0b-551e-4a18-8571-aac363dd0095 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:40.124863 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4c8b4a0b-551e-4a18-8571-aac363dd0095 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:40.125373 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4c8b4a0b-551e-4a18-8571-aac363dd0095 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:40.133176 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-468ac90f-975d-44eb-a958-168f0205c298 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:40.146339 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-468ac90f-975d-44eb-a958-168f0205c298 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:40.151681 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-468ac90f-975d-44eb-a958-168f0205c298 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:40.153784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-468ac90f-975d-44eb-a958-168f0205c298 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.539192 Jun 27 15:28:40.160787 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 133/268] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:39 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:40.584560 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4c8b4a0b-551e-4a18-8571-aac363dd0095 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:40.596420 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4c8b4a0b-551e-4a18-8571-aac363dd0095 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1367 microversion: 2.1 time: 0.562352 Jun 27 15:28:40.596980 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 136/269] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:40 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1367 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:40.619983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3e50f004-4c2a-40f3-98ba-c55033037bce tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:40.621024 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3e50f004-4c2a-40f3-98ba-c55033037bce tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:40.644004 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3e50f004-4c2a-40f3-98ba-c55033037bce tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:40.650970 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3e50f004-4c2a-40f3-98ba-c55033037bce tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:40.654893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3e50f004-4c2a-40f3-98ba-c55033037bce tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:40.656062 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3e50f004-4c2a-40f3-98ba-c55033037bce tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:41.015538 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3e50f004-4c2a-40f3-98ba-c55033037bce tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:41.036462 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3e50f004-4c2a-40f3-98ba-c55033037bce tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1313 microversion: 2.1 time: 0.421103 Jun 27 15:28:41.037068 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 134/270] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:40 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1313 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:41.051595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-14925eae-35b7-4683-8d87-9bbb38f71ffc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:41.057191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-14925eae-35b7-4683-8d87-9bbb38f71ffc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:41.087713 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-14925eae-35b7-4683-8d87-9bbb38f71ffc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:41.088178 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-14925eae-35b7-4683-8d87-9bbb38f71ffc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:41.089012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-14925eae-35b7-4683-8d87-9bbb38f71ffc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:41.092150 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-14925eae-35b7-4683-8d87-9bbb38f71ffc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:41.136017 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:41.174137 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2d83d6b9-ccf2-4217-b365-08ba82d8be1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:41.174760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2d83d6b9-ccf2-4217-b365-08ba82d8be1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:41.191278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2d83d6b9-ccf2-4217-b365-08ba82d8be1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:41.198603 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2d83d6b9-ccf2-4217-b365-08ba82d8be1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:41.199569 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2d83d6b9-ccf2-4217-b365-08ba82d8be1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:41.200083 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2d83d6b9-ccf2-4217-b365-08ba82d8be1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:41.429948 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-14925eae-35b7-4683-8d87-9bbb38f71ffc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:41.450738 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-14925eae-35b7-4683-8d87-9bbb38f71ffc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1510 microversion: 2.1 time: 0.406016 Jun 27 15:28:41.452297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 137/271] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:41 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1510 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:41.615086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d7f560d4-4424-4d69-bf70-f01a05452368 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:41.616140 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d7f560d4-4424-4d69-bf70-f01a05452368 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:41.637511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2d83d6b9-ccf2-4217-b365-08ba82d8be1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:41.648399 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d7f560d4-4424-4d69-bf70-f01a05452368 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:41.648399 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d7f560d4-4424-4d69-bf70-f01a05452368 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:41.648399 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d7f560d4-4424-4d69-bf70-f01a05452368 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:41.648399 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d7f560d4-4424-4d69-bf70-f01a05452368 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:41.655184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2d83d6b9-ccf2-4217-b365-08ba82d8be1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:41.658841 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2d83d6b9-ccf2-4217-b365-08ba82d8be1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:41.661667 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2d83d6b9-ccf2-4217-b365-08ba82d8be1b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.491804 Jun 27 15:28:41.663627 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 135/272] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:41 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:41.800172 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-eba01750-0873-41d2-becb-c5363d59733e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:41.830153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eba01750-0873-41d2-becb-c5363d59733e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:41.830847 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eba01750-0873-41d2-becb-c5363d59733e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:42.015370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-eba01750-0873-41d2-becb-c5363d59733e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Going to try to stop instance {{(pid=117978) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 15:28:42.160875 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-eba01750-0873-41d2-becb-c5363d59733e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/action" status: 202 len: 0 microversion: 2.1 time: 0.367955 Jun 27 15:28:42.162591 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 136/273] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:28:41 2022] POST /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/action => generated 0 bytes in 371 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:28:42.181836 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4bcf0ef4-ede9-4f5b-b912-28f4818a78c3 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:42.184172 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4bcf0ef4-ede9-4f5b-b912-28f4818a78c3 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:42.208273 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4bcf0ef4-ede9-4f5b-b912-28f4818a78c3 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:42.212490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4bcf0ef4-ede9-4f5b-b912-28f4818a78c3 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:42.213953 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4bcf0ef4-ede9-4f5b-b912-28f4818a78c3 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:42.214605 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4bcf0ef4-ede9-4f5b-b912-28f4818a78c3 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:42.381981 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d7f560d4-4424-4d69-bf70-f01a05452368 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:42.399615 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d7f560d4-4424-4d69-bf70-f01a05452368 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1557 microversion: 2.1 time: 0.789819 Jun 27 15:28:42.400674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 138/274] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:41 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1557 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:42.416565 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-78943016-e42b-46e3-845b-f597a283f0ee tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:42.417456 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-78943016-e42b-46e3-845b-f597a283f0ee tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:42.434138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-78943016-e42b-46e3-845b-f597a283f0ee tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:42.435176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-78943016-e42b-46e3-845b-f597a283f0ee tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:42.448774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-78943016-e42b-46e3-845b-f597a283f0ee tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:42.449361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-78943016-e42b-46e3-845b-f597a283f0ee tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:42.551278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4bcf0ef4-ede9-4f5b-b912-28f4818a78c3 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:42.578017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4bcf0ef4-ede9-4f5b-b912-28f4818a78c3 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1313 microversion: 2.1 time: 0.413456 Jun 27 15:28:42.578901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 137/275] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:42 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1313 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:42.585258 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-49635c6d-af44-4469-b4ae-97f19722dd6c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:42.586032 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-49635c6d-af44-4469-b4ae-97f19722dd6c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:42.595477 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-49635c6d-af44-4469-b4ae-97f19722dd6c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:42.596251 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-49635c6d-af44-4469-b4ae-97f19722dd6c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:42.598496 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-49635c6d-af44-4469-b4ae-97f19722dd6c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:42.599178 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-49635c6d-af44-4469-b4ae-97f19722dd6c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:42.899913 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-49635c6d-af44-4469-b4ae-97f19722dd6c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.318197 Jun 27 15:28:42.901228 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 138/276] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jun 27 15:28:42 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-interface => generated 285 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:42.909720 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f74700d1-e431-4c22-9db9-8140b19e0778 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:42.910872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f74700d1-e431-4c22-9db9-8140b19e0778 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:42.941951 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f74700d1-e431-4c22-9db9-8140b19e0778 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:42.942758 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f74700d1-e431-4c22-9db9-8140b19e0778 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:42.944082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f74700d1-e431-4c22-9db9-8140b19e0778 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:42.944959 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f74700d1-e431-4c22-9db9-8140b19e0778 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:43.100146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-78943016-e42b-46e3-845b-f597a283f0ee tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:43.134923 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-78943016-e42b-46e3-845b-f597a283f0ee tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 0.732648 Jun 27 15:28:43.144839 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 139/277] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:42 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 743 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:43.158541 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a3b88659-d4f0-4ade-99e5-573a812d0111 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:43.173880 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a3b88659-d4f0-4ade-99e5-573a812d0111 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:43.196409 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a3b88659-d4f0-4ade-99e5-573a812d0111 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:43.203671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a3b88659-d4f0-4ade-99e5-573a812d0111 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:43.205534 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a3b88659-d4f0-4ade-99e5-573a812d0111 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:43.206593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a3b88659-d4f0-4ade-99e5-573a812d0111 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:43.280916 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f74700d1-e431-4c22-9db9-8140b19e0778 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:43.302192 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f74700d1-e431-4c22-9db9-8140b19e0778 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1510 microversion: 2.1 time: 0.398578 Jun 27 15:28:43.303971 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 139/278] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:42 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1510 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:43.602674 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-30155131-a274-4708-9d79-403b94fa76aa tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:43.613682 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-30155131-a274-4708-9d79-403b94fa76aa tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:43.617424 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a3b88659-d4f0-4ade-99e5-573a812d0111 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:43.631880 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a3b88659-d4f0-4ade-99e5-573a812d0111 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:43.636027 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a3b88659-d4f0-4ade-99e5-573a812d0111 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:43.640180 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a3b88659-d4f0-4ade-99e5-573a812d0111 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.489571 Jun 27 15:28:43.653801 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 140/279] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:43 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:43.677567 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30155131-a274-4708-9d79-403b94fa76aa tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:43.681900 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30155131-a274-4708-9d79-403b94fa76aa tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:43.687461 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30155131-a274-4708-9d79-403b94fa76aa tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:43.693006 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30155131-a274-4708-9d79-403b94fa76aa tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:43.858418 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-4796635f-c25f-4472-beed-d3746d5049ee req-271f237d-cf5c-458d-bbc2-b420e53b5dec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42a451d5-56c8-46fc-914e-2b990c2bd155", "name": "network-vif-plugged", "status": "completed", "tag": "ea4ab95e-cf94-42bd-ab76-851264e40c78"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:43.946942 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-4796635f-c25f-4472-beed-d3746d5049ee req-271f237d-cf5c-458d-bbc2-b420e53b5dec service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:43.946942 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-4796635f-c25f-4472-beed-d3746d5049ee req-271f237d-cf5c-458d-bbc2-b420e53b5dec service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:44.005523 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-4796635f-c25f-4472-beed-d3746d5049ee req-271f237d-cf5c-458d-bbc2-b420e53b5dec service nova] Creating event network-vif-plugged:ea4ab95e-cf94-42bd-ab76-851264e40c78 for instance 42a451d5-56c8-46fc-914e-2b990c2bd155 on hv-cinder-84779 Jun 27 15:28:44.032270 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-4796635f-c25f-4472-beed-d3746d5049ee req-271f237d-cf5c-458d-bbc2-b420e53b5dec service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.190083 Jun 27 15:28:44.036889 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 141/280] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:28:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:28:44.166568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e486c899-90e2-4b80-9b65-9d4343ba0eb6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:44.167623 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e486c899-90e2-4b80-9b65-9d4343ba0eb6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:44.184987 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e486c899-90e2-4b80-9b65-9d4343ba0eb6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:44.187170 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e486c899-90e2-4b80-9b65-9d4343ba0eb6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:44.188242 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e486c899-90e2-4b80-9b65-9d4343ba0eb6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:44.192483 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e486c899-90e2-4b80-9b65-9d4343ba0eb6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:44.198985 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-30155131-a274-4708-9d79-403b94fa76aa tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:44.223922 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-30155131-a274-4708-9d79-403b94fa76aa tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1313 microversion: 2.1 time: 0.629259 Jun 27 15:28:44.227885 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 140/281] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:43 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1313 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:44.335072 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9e46a7d9-fdd5-4fe6-8ee3-c4832068cb95 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:44.336642 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9e46a7d9-fdd5-4fe6-8ee3-c4832068cb95 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:44.361512 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e46a7d9-fdd5-4fe6-8ee3-c4832068cb95 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:44.363266 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e46a7d9-fdd5-4fe6-8ee3-c4832068cb95 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:44.366235 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e46a7d9-fdd5-4fe6-8ee3-c4832068cb95 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:44.367422 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e46a7d9-fdd5-4fe6-8ee3-c4832068cb95 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:44.465250 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:44.549431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e486c899-90e2-4b80-9b65-9d4343ba0eb6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:44.590816 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e486c899-90e2-4b80-9b65-9d4343ba0eb6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 0.428514 Jun 27 15:28:44.605661 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 142/282] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:44 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:44.669225 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-94d4c8db-99ae-4128-ab86-aec487d6ee57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:44.671401 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-94d4c8db-99ae-4128-ab86-aec487d6ee57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:44.680114 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-94d4c8db-99ae-4128-ab86-aec487d6ee57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:44.681001 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-94d4c8db-99ae-4128-ab86-aec487d6ee57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:44.682463 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-94d4c8db-99ae-4128-ab86-aec487d6ee57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:44.683116 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-94d4c8db-99ae-4128-ab86-aec487d6ee57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:44.757432 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9e46a7d9-fdd5-4fe6-8ee3-c4832068cb95 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:44.770955 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9e46a7d9-fdd5-4fe6-8ee3-c4832068cb95 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1510 microversion: 2.1 time: 0.442702 Jun 27 15:28:44.772447 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 141/283] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:44 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1510 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:45.095843 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-94d4c8db-99ae-4128-ab86-aec487d6ee57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:45.109636 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-94d4c8db-99ae-4128-ab86-aec487d6ee57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:45.119683 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-94d4c8db-99ae-4128-ab86-aec487d6ee57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:45.119683 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-94d4c8db-99ae-4128-ab86-aec487d6ee57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.454039 Jun 27 15:28:45.119683 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 143/284] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:44 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:45.179314 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-81cdc9c3-d311-48d2-93c4-b6a36fcd6a5c req-8406e91b-adc2-4aff-9bf7-39f23c03fea2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "598844cf-f73b-4630-ad12-f08ab67e89e3", "tag": "209e6ff3-398f-4386-b25b-aef36d5f7e9c"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:45.198835 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-81cdc9c3-d311-48d2-93c4-b6a36fcd6a5c req-8406e91b-adc2-4aff-9bf7-39f23c03fea2 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:45.199382 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-81cdc9c3-d311-48d2-93c4-b6a36fcd6a5c req-8406e91b-adc2-4aff-9bf7-39f23c03fea2 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:45.217863 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-81cdc9c3-d311-48d2-93c4-b6a36fcd6a5c req-8406e91b-adc2-4aff-9bf7-39f23c03fea2 service nova] Creating event network-changed:209e6ff3-398f-4386-b25b-aef36d5f7e9c for instance 598844cf-f73b-4630-ad12-f08ab67e89e3 on hv-cinder-84779 Jun 27 15:28:45.224062 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-81cdc9c3-d311-48d2-93c4-b6a36fcd6a5c req-8406e91b-adc2-4aff-9bf7-39f23c03fea2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048509 Jun 27 15:28:45.225468 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 142/285] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:28:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:45.258617 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-24338de1-f9b8-40bf-8dbf-a743332b3a8f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:45.259908 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-24338de1-f9b8-40bf-8dbf-a743332b3a8f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:45.269111 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-24338de1-f9b8-40bf-8dbf-a743332b3a8f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:45.270157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-24338de1-f9b8-40bf-8dbf-a743332b3a8f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:45.271167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-24338de1-f9b8-40bf-8dbf-a743332b3a8f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:45.271782 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-24338de1-f9b8-40bf-8dbf-a743332b3a8f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:45.507470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-24338de1-f9b8-40bf-8dbf-a743332b3a8f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:45.518283 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-24338de1-f9b8-40bf-8dbf-a743332b3a8f tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1313 microversion: 2.1 time: 0.271233 Jun 27 15:28:45.528664 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 144/286] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:45 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1313 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:45.623200 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-77eeae78-c12e-4798-843a-f19b8c2a9433 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:45.624109 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-77eeae78-c12e-4798-843a-f19b8c2a9433 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:45.644116 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77eeae78-c12e-4798-843a-f19b8c2a9433 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:45.645003 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77eeae78-c12e-4798-843a-f19b8c2a9433 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:45.646911 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77eeae78-c12e-4798-843a-f19b8c2a9433 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:45.649982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-77eeae78-c12e-4798-843a-f19b8c2a9433 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:45.793651 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-47d155a6-fc7b-4caa-a0bd-528cae0d7aeb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:45.794229 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-47d155a6-fc7b-4caa-a0bd-528cae0d7aeb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:45.806104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-47d155a6-fc7b-4caa-a0bd-528cae0d7aeb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:45.806561 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-47d155a6-fc7b-4caa-a0bd-528cae0d7aeb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:45.807364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-47d155a6-fc7b-4caa-a0bd-528cae0d7aeb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:45.807793 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-47d155a6-fc7b-4caa-a0bd-528cae0d7aeb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:46.039000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-77eeae78-c12e-4798-843a-f19b8c2a9433 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:46.050679 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-77eeae78-c12e-4798-843a-f19b8c2a9433 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 0.432486 Jun 27 15:28:46.079233 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 143/287] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:45 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:46.146209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-df09ebbc-f6af-4831-b4da-a68edddfe76e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:46.154133 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-df09ebbc-f6af-4831-b4da-a68edddfe76e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:46.173187 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df09ebbc-f6af-4831-b4da-a68edddfe76e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:46.175676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df09ebbc-f6af-4831-b4da-a68edddfe76e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:46.175676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df09ebbc-f6af-4831-b4da-a68edddfe76e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:46.175676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df09ebbc-f6af-4831-b4da-a68edddfe76e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:46.434627 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-df09ebbc-f6af-4831-b4da-a68edddfe76e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:46.450371 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-df09ebbc-f6af-4831-b4da-a68edddfe76e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:46.454034 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-df09ebbc-f6af-4831-b4da-a68edddfe76e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:46.457973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-df09ebbc-f6af-4831-b4da-a68edddfe76e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.324476 Jun 27 15:28:46.462802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 144/288] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:46 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:46.544110 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5c1198e1-699d-4e19-8a0c-95ecf9e37ed5 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:46.556089 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5c1198e1-699d-4e19-8a0c-95ecf9e37ed5 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:46.559921 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c1198e1-699d-4e19-8a0c-95ecf9e37ed5 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:46.561967 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c1198e1-699d-4e19-8a0c-95ecf9e37ed5 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:46.563619 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c1198e1-699d-4e19-8a0c-95ecf9e37ed5 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:46.565291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c1198e1-699d-4e19-8a0c-95ecf9e37ed5 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:46.753750 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-47d155a6-fc7b-4caa-a0bd-528cae0d7aeb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:46.791088 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-47d155a6-fc7b-4caa-a0bd-528cae0d7aeb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1516 microversion: 2.1 time: 0.992720 Jun 27 15:28:46.807143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 145/289] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:45 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1516 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:46.872746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5c1198e1-699d-4e19-8a0c-95ecf9e37ed5 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:46.881666 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5c1198e1-699d-4e19-8a0c-95ecf9e37ed5 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1313 microversion: 2.1 time: 0.348158 Jun 27 15:28:46.882587 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 145/290] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:46 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1313 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:47.091807 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-23bb35af-f65b-4f7f-967f-226aab0eeea7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:47.092923 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-23bb35af-f65b-4f7f-967f-226aab0eeea7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:47.103245 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23bb35af-f65b-4f7f-967f-226aab0eeea7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:47.104723 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23bb35af-f65b-4f7f-967f-226aab0eeea7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:47.105758 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23bb35af-f65b-4f7f-967f-226aab0eeea7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:47.106427 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23bb35af-f65b-4f7f-967f-226aab0eeea7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:47.481704 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a295eba9-eddf-4e45-85d7-2d22cca9a3fe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:47.483736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a295eba9-eddf-4e45-85d7-2d22cca9a3fe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:47.491564 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a295eba9-eddf-4e45-85d7-2d22cca9a3fe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:47.492445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a295eba9-eddf-4e45-85d7-2d22cca9a3fe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:47.493485 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a295eba9-eddf-4e45-85d7-2d22cca9a3fe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:47.494137 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a295eba9-eddf-4e45-85d7-2d22cca9a3fe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:47.537680 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-23bb35af-f65b-4f7f-967f-226aab0eeea7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:47.550649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-23bb35af-f65b-4f7f-967f-226aab0eeea7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 0.469731 Jun 27 15:28:47.551627 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 146/291] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:47 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:47.704043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a295eba9-eddf-4e45-85d7-2d22cca9a3fe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:47.728259 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a295eba9-eddf-4e45-85d7-2d22cca9a3fe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:47.731576 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a295eba9-eddf-4e45-85d7-2d22cca9a3fe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:47.735308 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a295eba9-eddf-4e45-85d7-2d22cca9a3fe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.257077 Jun 27 15:28:47.745831 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 146/292] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:47 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:28:47.903868 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a01d0953-8b18-48b5-b1ed-55f650efee91 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:47.904649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a01d0953-8b18-48b5-b1ed-55f650efee91 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:47.911181 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a01d0953-8b18-48b5-b1ed-55f650efee91 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:47.911959 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a01d0953-8b18-48b5-b1ed-55f650efee91 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:47.912963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a01d0953-8b18-48b5-b1ed-55f650efee91 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:47.913389 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a01d0953-8b18-48b5-b1ed-55f650efee91 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:48.120842 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a01d0953-8b18-48b5-b1ed-55f650efee91 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:48.136711 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a01d0953-8b18-48b5-b1ed-55f650efee91 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1497 microversion: 2.1 time: 0.236177 Jun 27 15:28:48.138211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 147/293] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:47 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1497 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:48.570253 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-75f06e8a-5ff3-41e3-b11e-02e66b9072e1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:48.571795 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-75f06e8a-5ff3-41e3-b11e-02e66b9072e1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:48.582996 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c3bdfe42-ec9f-4275-bd27-655fb6a495f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'create', calling method: .version_select at 0x7fb2737af1f0>, body: {"keypair": {"name": "tempest-keypair-1032320801", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJg2RfYk2Ct7dYfvGZoVv0d8EhN73iK5Lnm3TEzRD8g1M5cJEHSE9gmyZQDeiCss7ouAPFnZZF+N/esqMKnEzzwYC0vyR9MXomIVsG7/+Ddri8s7/PnIb+90tsx8r1lWJQ=="}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:48.588482 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-75f06e8a-5ff3-41e3-b11e-02e66b9072e1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:48.593915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-75f06e8a-5ff3-41e3-b11e-02e66b9072e1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:48.594983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-75f06e8a-5ff3-41e3-b11e-02e66b9072e1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:48.596753 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-75f06e8a-5ff3-41e3-b11e-02e66b9072e1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:48.637190 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-c3bdfe42-ec9f-4275-bd27-655fb6a495f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Getting quotas for project 2832173587a6494eb7f73b3ca0a09a0f. Resources: {'key_pairs'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:28:48.646868 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-c3bdfe42-ec9f-4275-bd27-655fb6a495f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Getting quotas for user effe0200dc584f11923e83ed240138ff and project 2832173587a6494eb7f73b3ca0a09a0f. Resources: {'key_pairs'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:28:48.700226 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c3bdfe42-ec9f-4275-bd27-655fb6a495f4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.124416 Jun 27 15:28:48.709611 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 148/294] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jun 27 15:28:48 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:28:48.760695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-77b1b9fd-fefc-4735-889c-bcc2a1e75da4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:48.761378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-77b1b9fd-fefc-4735-889c-bcc2a1e75da4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:48.770479 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77b1b9fd-fefc-4735-889c-bcc2a1e75da4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:48.771319 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77b1b9fd-fefc-4735-889c-bcc2a1e75da4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:48.772734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77b1b9fd-fefc-4735-889c-bcc2a1e75da4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:48.791513 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77b1b9fd-fefc-4735-889c-bcc2a1e75da4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:48.809859 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-75f06e8a-5ff3-41e3-b11e-02e66b9072e1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:48.822940 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-75f06e8a-5ff3-41e3-b11e-02e66b9072e1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 0.257860 Jun 27 15:28:48.823533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 147/295] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:48 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:48.946109 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-28959183-c68a-4c82-9e49-60b3c432f408 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:48.946622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-28959183-c68a-4c82-9e49-60b3c432f408 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:48.954242 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28959183-c68a-4c82-9e49-60b3c432f408 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:48.955664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28959183-c68a-4c82-9e49-60b3c432f408 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:48.956488 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28959183-c68a-4c82-9e49-60b3c432f408 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:48.957070 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-28959183-c68a-4c82-9e49-60b3c432f408 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:49.006037 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-28959183-c68a-4c82-9e49-60b3c432f408 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:28:49.092927 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-77b1b9fd-fefc-4735-889c-bcc2a1e75da4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:49.102207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-77b1b9fd-fefc-4735-889c-bcc2a1e75da4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:49.104048 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-77b1b9fd-fefc-4735-889c-bcc2a1e75da4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:49.105575 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-77b1b9fd-fefc-4735-889c-bcc2a1e75da4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1743 microversion: 2.20 time: 0.349616 Jun 27 15:28:49.106351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 149/296] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:48 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1743 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:28:49.153108 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-28959183-c68a-4c82-9e49-60b3c432f408 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "DELETE /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 204 len: 0 microversion: 2.1 time: 0.210389 Jun 27 15:28:49.160275 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 148/297] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:28:48 2022] DELETE /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:28:49.164660 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2e0225a5-2a9a-4759-b107-71a4ae709ad2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:49.165600 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2e0225a5-2a9a-4759-b107-71a4ae709ad2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:49.173015 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2e0225a5-2a9a-4759-b107-71a4ae709ad2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:49.175151 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2e0225a5-2a9a-4759-b107-71a4ae709ad2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:49.176922 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2e0225a5-2a9a-4759-b107-71a4ae709ad2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:49.177935 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2e0225a5-2a9a-4759-b107-71a4ae709ad2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:49.423553 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2e0225a5-2a9a-4759-b107-71a4ae709ad2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:49.438916 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2e0225a5-2a9a-4759-b107-71a4ae709ad2 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1503 microversion: 2.1 time: 0.278723 Jun 27 15:28:49.440366 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 150/298] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:49 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1503 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:49.875007 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-de9d50e4-dec2-4af8-a222-5104fabf81fb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:49.876711 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-de9d50e4-dec2-4af8-a222-5104fabf81fb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:49.890575 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de9d50e4-dec2-4af8-a222-5104fabf81fb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:49.902152 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de9d50e4-dec2-4af8-a222-5104fabf81fb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:49.903271 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de9d50e4-dec2-4af8-a222-5104fabf81fb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:49.903920 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de9d50e4-dec2-4af8-a222-5104fabf81fb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:50.127106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5c532e22-6bf3-4520-bb49-054cbc85e246 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:50.128098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5c532e22-6bf3-4520-bb49-054cbc85e246 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:50.138825 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5c532e22-6bf3-4520-bb49-054cbc85e246 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:50.140512 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5c532e22-6bf3-4520-bb49-054cbc85e246 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:50.143307 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5c532e22-6bf3-4520-bb49-054cbc85e246 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:50.144240 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5c532e22-6bf3-4520-bb49-054cbc85e246 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:50.192172 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-de9d50e4-dec2-4af8-a222-5104fabf81fb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:50.205313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-de9d50e4-dec2-4af8-a222-5104fabf81fb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 0.348991 Jun 27 15:28:50.220809 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 149/299] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:49 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:50.457675 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bb1d4930-8c89-46f2-92cc-fdc2e60bbf22 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:50.458403 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bb1d4930-8c89-46f2-92cc-fdc2e60bbf22 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:50.467990 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb1d4930-8c89-46f2-92cc-fdc2e60bbf22 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:50.480830 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb1d4930-8c89-46f2-92cc-fdc2e60bbf22 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:50.481946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb1d4930-8c89-46f2-92cc-fdc2e60bbf22 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:50.482419 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb1d4930-8c89-46f2-92cc-fdc2e60bbf22 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:50.578267 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5c532e22-6bf3-4520-bb49-054cbc85e246 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:50.595720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5c532e22-6bf3-4520-bb49-054cbc85e246 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:50.598990 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5c532e22-6bf3-4520-bb49-054cbc85e246 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:50.601580 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5c532e22-6bf3-4520-bb49-054cbc85e246 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1743 microversion: 2.20 time: 0.478322 Jun 27 15:28:50.608479 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 151/300] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:50 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1743 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:28:50.738710 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bb1d4930-8c89-46f2-92cc-fdc2e60bbf22 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:50.749215 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bb1d4930-8c89-46f2-92cc-fdc2e60bbf22 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1503 microversion: 2.1 time: 0.295501 Jun 27 15:28:50.751045 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 150/301] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:50 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1503 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:51.227740 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-22f162b8-2575-4060-b130-8477c310e458 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:51.228490 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-22f162b8-2575-4060-b130-8477c310e458 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:51.239234 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-22f162b8-2575-4060-b130-8477c310e458 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:51.239970 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-22f162b8-2575-4060-b130-8477c310e458 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:51.241285 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-22f162b8-2575-4060-b130-8477c310e458 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:51.242369 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-22f162b8-2575-4060-b130-8477c310e458 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:51.633530 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-34315d4b-5b09-42c6-94cb-e9e5c746f5b6 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:51.639640 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-34315d4b-5b09-42c6-94cb-e9e5c746f5b6 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:51.662770 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34315d4b-5b09-42c6-94cb-e9e5c746f5b6 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:51.664238 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34315d4b-5b09-42c6-94cb-e9e5c746f5b6 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:51.666951 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34315d4b-5b09-42c6-94cb-e9e5c746f5b6 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:51.668820 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34315d4b-5b09-42c6-94cb-e9e5c746f5b6 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:51.988597 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-34315d4b-5b09-42c6-94cb-e9e5c746f5b6 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:52.005829 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-34315d4b-5b09-42c6-94cb-e9e5c746f5b6 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:52.008431 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-34315d4b-5b09-42c6-94cb-e9e5c746f5b6 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:52.015424 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-34315d4b-5b09-42c6-94cb-e9e5c746f5b6 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.390489 Jun 27 15:28:52.021302 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 151/302] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:51 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:52.026419 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-de06fc8c-33b0-4b79-93d6-30103325f610 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:52.041415 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-de06fc8c-33b0-4b79-93d6-30103325f610 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:52.050315 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de06fc8c-33b0-4b79-93d6-30103325f610 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:52.050956 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de06fc8c-33b0-4b79-93d6-30103325f610 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:52.052852 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de06fc8c-33b0-4b79-93d6-30103325f610 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:52.053549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de06fc8c-33b0-4b79-93d6-30103325f610 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:52.280922 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-de06fc8c-33b0-4b79-93d6-30103325f610 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b9d9cb0073b5452698e549792adf6733', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b99a389f8cd34552ae1b3c30803669ae', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:52.290763 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-de06fc8c-33b0-4b79-93d6-30103325f610 tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 200 len: 1503 microversion: 2.1 time: 0.268060 Jun 27 15:28:52.292714 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-22f162b8-2575-4060-b130-8477c310e458 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:52.299196 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 152/303] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:52 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 1503 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:52.305017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-1bc7da88-40d2-4ada-b20f-9d65fbe27c35 req-d36b79b6-6188-4a25-a0de-5862cea701eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831291d0-f04d-4927-afcd-88fd058db642", "name": "network-vif-plugged", "status": "completed", "tag": "62696634-23e0-4313-bcf8-d3be6665d3aa"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:52.317985 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-1bc7da88-40d2-4ada-b20f-9d65fbe27c35 req-d36b79b6-6188-4a25-a0de-5862cea701eb service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:52.318495 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-1bc7da88-40d2-4ada-b20f-9d65fbe27c35 req-d36b79b6-6188-4a25-a0de-5862cea701eb service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:52.335583 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-22f162b8-2575-4060-b130-8477c310e458 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 1.100782 Jun 27 15:28:52.335947 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-1bc7da88-40d2-4ada-b20f-9d65fbe27c35 req-d36b79b6-6188-4a25-a0de-5862cea701eb service nova] Creating event network-vif-plugged:62696634-23e0-4313-bcf8-d3be6665d3aa for instance 831291d0-f04d-4927-afcd-88fd058db642 on hv-cinder-84779 Jun 27 15:28:52.336594 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 152/304] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:51 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:52.347253 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-1bc7da88-40d2-4ada-b20f-9d65fbe27c35 req-d36b79b6-6188-4a25-a0de-5862cea701eb service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044970 Jun 27 15:28:52.349243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 153/305] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:28:52.481026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-566682104", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "0dd13161-8ee5-4285-a373-761f6ed0abd7"}], "security_groups": [{"name": "tempest-securitygroup--517480710"}], "key_name": "tempest-keypair-1032320801", "user_data": "}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:52.564152 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-26c772d0-6094-491c-b73c-ca5645920541 req-ed038b50-dca6-4e5d-b642-cacd5939e187 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "42a451d5-56c8-46fc-914e-2b990c2bd155", "name": "network-vif-deleted", "tag": "ea4ab95e-cf94-42bd-ab76-851264e40c78"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:52.574981 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-26c772d0-6094-491c-b73c-ca5645920541 req-ed038b50-dca6-4e5d-b642-cacd5939e187 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:52.575738 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-26c772d0-6094-491c-b73c-ca5645920541 req-ed038b50-dca6-4e5d-b642-cacd5939e187 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:52.597889 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-26c772d0-6094-491c-b73c-ca5645920541 req-ed038b50-dca6-4e5d-b642-cacd5939e187 service nova] Creating event network-vif-deleted:ea4ab95e-cf94-42bd-ab76-851264e40c78 for instance 42a451d5-56c8-46fc-914e-2b990c2bd155 on hv-cinder-84779 Jun 27 15:28:52.613533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-26c772d0-6094-491c-b73c-ca5645920541 req-ed038b50-dca6-4e5d-b642-cacd5939e187 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049990 Jun 27 15:28:52.630126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 154/306] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:28:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:28:53.043102 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fb672966-a5b9-4b07-a405-b9c6870ab244 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:53.043905 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fb672966-a5b9-4b07-a405-b9c6870ab244 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:53.064059 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb672966-a5b9-4b07-a405-b9c6870ab244 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:53.064887 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb672966-a5b9-4b07-a405-b9c6870ab244 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:53.065936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb672966-a5b9-4b07-a405-b9c6870ab244 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:53.066559 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb672966-a5b9-4b07-a405-b9c6870ab244 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:53.355885 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb672966-a5b9-4b07-a405-b9c6870ab244 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:53.375551 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb672966-a5b9-4b07-a405-b9c6870ab244 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:53.377659 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb672966-a5b9-4b07-a405-b9c6870ab244 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:53.379216 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fb672966-a5b9-4b07-a405-b9c6870ab244 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.341234 Jun 27 15:28:53.394956 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 155/307] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:53 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:53.401550 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d4187ca6-38b9-407c-8c6e-a1ad50eeb23b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:53.402666 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d4187ca6-38b9-407c-8c6e-a1ad50eeb23b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] [instance: 42a451d5-56c8-46fc-914e-2b990c2bd155] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:53.411282 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4187ca6-38b9-407c-8c6e-a1ad50eeb23b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:53.412419 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4187ca6-38b9-407c-8c6e-a1ad50eeb23b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:53.413604 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4187ca6-38b9-407c-8c6e-a1ad50eeb23b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:53.414349 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4187ca6-38b9-407c-8c6e-a1ad50eeb23b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:53.443147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-d4187ca6-38b9-407c-8c6e-a1ad50eeb23b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] HTTP exception thrown: Instance 42a451d5-56c8-46fc-914e-2b990c2bd155 could not be found. Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d4187ca6-38b9-407c-8c6e-a1ad50eeb23b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Request method failure captured: Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 HTTP/1.1 Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucx_MkOUNJ1MRfLOj-G8J4jnZv0MfLOxWyA64RU03HBPL8-1mMdkOnK8UDdseEpWwzmooDOPkgQLjkff500pIgNCOf2Rgf_VfK9nvcwx7exGxdoe1K25cS_Ki70WOjSACC4I_p_oKI4lhf-ATHMj6-9Uw_nMWRO56GWsOgK0nJS5L-c Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: b99a389f8cd34552ae1b3c30803669ae Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesActionsTest-702925784 Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:28:53.445736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b99a389f8cd34552ae1b3c30803669ae", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b99a389f8cd34552ae1b3c30803669ae"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99a389f8cd34552ae1b3c30803669ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b99a389f8cd34552ae1b3c30803669ae"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesActionsTest-702925784 Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: b99a389f8cd34552ae1b3c30803669ae Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesActionsTest-702925784 Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesActionsTest-702925784-project Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: b9d9cb0073b5452698e549792adf6733 Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesActionsTest-702925784-project Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 42a451d5-56c8-46fc-914e-2b990c2bd155 could not be found. Jun 27 15:28:53.447184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '42a451d5-56c8-46fc-914e-2b990c2bd155'} Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 42a451d5-56c8-46fc-914e-2b990c2bd155 could not be found. Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:28:53.447898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 42a451d5-56c8-46fc-914e-2b990c2bd155 could not be found. Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 42a451d5-56c8-46fc-914e-2b990c2bd155 could not be found. Jun 27 15:28:53.449084 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:28:53.452259 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d4187ca6-38b9-407c-8c6e-a1ad50eeb23b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] Returning 404 to user: Instance 42a451d5-56c8-46fc-914e-2b990c2bd155 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:28:53.453581 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d4187ca6-38b9-407c-8c6e-a1ad50eeb23b tempest-VolumesActionsTest-702925784 tempest-VolumesActionsTest-702925784-project] 10.222.0.26 "GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155" status: 404 len: 111 microversion: 2.1 time: 0.056776 Jun 27 15:28:53.475259 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 156/308] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:53 2022] GET /compute/v2.1/servers/42a451d5-56c8-46fc-914e-2b990c2bd155 => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:28:53.499817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1dc6641a-fd63-46d9-9ba8-fe093a41da63 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:53.505564 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1dc6641a-fd63-46d9-9ba8-fe093a41da63 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:53.519229 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1dc6641a-fd63-46d9-9ba8-fe093a41da63 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:53.537848 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1dc6641a-fd63-46d9-9ba8-fe093a41da63 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:53.538945 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1dc6641a-fd63-46d9-9ba8-fe093a41da63 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:53.542692 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1dc6641a-fd63-46d9-9ba8-fe093a41da63 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:53.903754 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1dc6641a-fd63-46d9-9ba8-fe093a41da63 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:53.920643 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1dc6641a-fd63-46d9-9ba8-fe093a41da63 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 0.440147 Jun 27 15:28:53.932256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 157/309] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:53 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:54.405809 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6e691d75-d870-4e6d-a8e2-dc25aec02ea7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:54.406871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6e691d75-d870-4e6d-a8e2-dc25aec02ea7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:54.426378 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e691d75-d870-4e6d-a8e2-dc25aec02ea7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:54.426546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e691d75-d870-4e6d-a8e2-dc25aec02ea7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:54.427352 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e691d75-d870-4e6d-a8e2-dc25aec02ea7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:54.427788 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e691d75-d870-4e6d-a8e2-dc25aec02ea7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:54.712510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6e691d75-d870-4e6d-a8e2-dc25aec02ea7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:54.749110 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6e691d75-d870-4e6d-a8e2-dc25aec02ea7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:54.755905 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6e691d75-d870-4e6d-a8e2-dc25aec02ea7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:54.759763 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6e691d75-d870-4e6d-a8e2-dc25aec02ea7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.360550 Jun 27 15:28:54.765904 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 158/310] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:54 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:54.947420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fdce378c-432a-453d-bc90-d65b01db8ff6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:54.948480 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fdce378c-432a-453d-bc90-d65b01db8ff6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:54.962499 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdce378c-432a-453d-bc90-d65b01db8ff6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:54.964492 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdce378c-432a-453d-bc90-d65b01db8ff6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:54.967373 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdce378c-432a-453d-bc90-d65b01db8ff6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:54.969875 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdce378c-432a-453d-bc90-d65b01db8ff6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:54.973928 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:55.215904 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fdce378c-432a-453d-bc90-d65b01db8ff6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:55.215904 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fdce378c-432a-453d-bc90-d65b01db8ff6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 0.262610 Jun 27 15:28:55.215904 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 159/311] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:54 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:55.570407 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2049445c-fab7-40e6-b6fb-82e3dfa8e4d7 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Action: 'create', calling method: .version_select at 0x7fb278116af0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-803733481", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlNiwLMCE6iPwY9rj0hlxze52z20otoS+Sk9A9G04ph1Sgj7QMr1X1IJonQtNJrtO8PBJk3k8AuUmEb77FvrX+RtFbLj4W8Mrzc3Xx54Ret6FsieZzeqMY7BNhyP/GJNg=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:55.617023 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-2049445c-fab7-40e6-b6fb-82e3dfa8e4d7 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Getting quotas for project 52c96385e67941648eee6bf532b3f141. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:28:55.632063 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-2049445c-fab7-40e6-b6fb-82e3dfa8e4d7 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Getting quotas for user d6682b6bd10a4609b68db0bd02f193b6 and project 52c96385e67941648eee6bf532b3f141. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:28:55.696069 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] validate_networks() for [('0dd13161-8ee5-4285-a373-761f6ed0abd7', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:28:55.703409 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2049445c-fab7-40e6-b6fb-82e3dfa8e4d7 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.136802 Jun 27 15:28:55.724355 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 160/312] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jun 27 15:28:55 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:28:55.796782 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-26340a3d-e6cd-4e8a-9f01-dd8b2505f4cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:55.797309 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-26340a3d-e6cd-4e8a-9f01-dd8b2505f4cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:55.810635 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-26340a3d-e6cd-4e8a-9f01-dd8b2505f4cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:55.810980 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-26340a3d-e6cd-4e8a-9f01-dd8b2505f4cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:55.819314 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-26340a3d-e6cd-4e8a-9f01-dd8b2505f4cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:55.819907 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-26340a3d-e6cd-4e8a-9f01-dd8b2505f4cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:56.066021 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-26340a3d-e6cd-4e8a-9f01-dd8b2505f4cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:56.083193 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-26340a3d-e6cd-4e8a-9f01-dd8b2505f4cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:56.085616 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-26340a3d-e6cd-4e8a-9f01-dd8b2505f4cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:56.089142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-26340a3d-e6cd-4e8a-9f01-dd8b2505f4cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.297598 Jun 27 15:28:56.123310 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 161/313] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:55 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:28:56.131841 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1912416765", "imageRef": "64dd40c9-8b44-4cf3-a4cf-081dd9981efd", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-803733481", "networks": [{"uuid": "79265a58-e851-4f46-80e6-8bd40ee58e6c"}]}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:56.234710 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] validate_networks() for [('79265a58-e851-4f46-80e6-8bd40ee58e6c', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:28:56.625632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:56.633967 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:28:56.634385 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:28:56.634856 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:28:56.635318 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:28:56.635684 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:28:56.653435 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:56.654185 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:56.655163 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:56.655856 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:56.677621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Getting quotas for project 2832173587a6494eb7f73b3ca0a09a0f. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:28:56.682922 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Getting quotas for user effe0200dc584f11923e83ed240138ff and project 2832173587a6494eb7f73b3ca0a09a0f. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:28:56.706981 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:28:56.710143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:28:56.755055 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:56.784934 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-54fe4878-d608-4780-b01e-3672a2e4320c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 4.308135 Jun 27 15:28:56.786329 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 153/314] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:28:52 2022] POST /compute/v2.1/servers => generated 408 bytes in 4311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:28:56.796435 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5f6bca51-35dd-4d91-b5e9-ab1ca68d7ef9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:56.797339 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5f6bca51-35dd-4d91-b5e9-ab1ca68d7ef9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:56.805677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5f6bca51-35dd-4d91-b5e9-ab1ca68d7ef9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:56.806117 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5f6bca51-35dd-4d91-b5e9-ab1ca68d7ef9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:56.807064 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5f6bca51-35dd-4d91-b5e9-ab1ca68d7ef9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:56.807659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5f6bca51-35dd-4d91-b5e9-ab1ca68d7ef9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:57.086552 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:28:57.086975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:28:57.087649 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:28:57.088240 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:28:57.088852 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:28:57.104082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:57.105369 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:57.106448 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:57.107094 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:57.131713 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Getting quotas for project 52c96385e67941648eee6bf532b3f141. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:28:57.139727 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Getting quotas for user d6682b6bd10a4609b68db0bd02f193b6 and project 52c96385e67941648eee6bf532b3f141. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:28:57.173562 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:28:57.178783 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='64dd40c9-8b44-4cf3-a4cf-081dd9981efd',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:28:57.221561 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5f6bca51-35dd-4d91-b5e9-ab1ca68d7ef9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:57.239811 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5f6bca51-35dd-4d91-b5e9-ab1ca68d7ef9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 0.451549 Jun 27 15:28:57.240638 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 154/315] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:56 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:57.262008 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-dcd9b4ca-c780-4171-827d-44f6989d6d04 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:57.263420 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-dcd9b4ca-c780-4171-827d-44f6989d6d04 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:57.389333 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4a3483de-aba8-4b9c-a497-1b7dc17a6ed6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.259231 Jun 27 15:28:57.400116 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 162/316] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:28:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 1276 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:28:57.416903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-dcd9b4ca-c780-4171-827d-44f6989d6d04 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:57.422382 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0c4270ec-d32e-40f4-8fe0-349627c45ffa tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:57.423861 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0c4270ec-d32e-40f4-8fe0-349627c45ffa tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:57.434408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-dcd9b4ca-c780-4171-827d-44f6989d6d04 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1245 microversion: 2.1 time: 0.189702 Jun 27 15:28:57.444505 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 155/317] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:57 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1245 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:57.450523 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c4270ec-d32e-40f4-8fe0-349627c45ffa tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:57.466263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c4270ec-d32e-40f4-8fe0-349627c45ffa tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:57.468173 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-08fc385f-b17f-4d6b-a8b0-b44b159675df tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:57.470291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c4270ec-d32e-40f4-8fe0-349627c45ffa tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:57.473502 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c4270ec-d32e-40f4-8fe0-349627c45ffa tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:57.485466 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-08fc385f-b17f-4d6b-a8b0-b44b159675df tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:57.704908 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-08fc385f-b17f-4d6b-a8b0-b44b159675df tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:57.732462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-08fc385f-b17f-4d6b-a8b0-b44b159675df tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1258 microversion: 2.1 time: 0.285515 Jun 27 15:28:57.733546 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 156/318] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:57 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1258 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:57.743718 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0c4270ec-d32e-40f4-8fe0-349627c45ffa tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:57.759501 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0c4270ec-d32e-40f4-8fe0-349627c45ffa tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:57.761902 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0c4270ec-d32e-40f4-8fe0-349627c45ffa tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:57.764418 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0c4270ec-d32e-40f4-8fe0-349627c45ffa tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.362231 Jun 27 15:28:57.778933 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 163/319] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:57 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:58.262260 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-cb69ae55-e318-4c6b-8561-cf6dcf021452 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:58.266509 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-cb69ae55-e318-4c6b-8561-cf6dcf021452 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:58.283032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cb69ae55-e318-4c6b-8561-cf6dcf021452 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:58.284012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cb69ae55-e318-4c6b-8561-cf6dcf021452 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:58.285134 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cb69ae55-e318-4c6b-8561-cf6dcf021452 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:58.285808 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cb69ae55-e318-4c6b-8561-cf6dcf021452 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:58.463503 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e10c14b2-5eb7-45cb-a701-273d05076feb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:58.464966 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e10c14b2-5eb7-45cb-a701-273d05076feb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:58.478377 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e10c14b2-5eb7-45cb-a701-273d05076feb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:58.479655 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e10c14b2-5eb7-45cb-a701-273d05076feb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:58.481584 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e10c14b2-5eb7-45cb-a701-273d05076feb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:58.482653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e10c14b2-5eb7-45cb-a701-273d05076feb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:58.534974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-cb69ae55-e318-4c6b-8561-cf6dcf021452 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:58.557541 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-cb69ae55-e318-4c6b-8561-cf6dcf021452 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1721 microversion: 2.1 time: 0.302412 Jun 27 15:28:58.569645 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 157/320] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:58 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1721 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:58.752623 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-cc82df9d-52ca-4425-a50c-f455f56de92b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:58.753666 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-cc82df9d-52ca-4425-a50c-f455f56de92b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:58.766124 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc82df9d-52ca-4425-a50c-f455f56de92b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:58.768631 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc82df9d-52ca-4425-a50c-f455f56de92b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:58.769731 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc82df9d-52ca-4425-a50c-f455f56de92b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:58.771672 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc82df9d-52ca-4425-a50c-f455f56de92b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:58.836551 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=100 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:28:58.952840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-cc82df9d-52ca-4425-a50c-f455f56de92b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:58.970454 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-cc82df9d-52ca-4425-a50c-f455f56de92b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1262 microversion: 2.1 time: 0.221786 Jun 27 15:28:58.972105 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 158/321] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:58 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1262 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:58.980565 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f32e90d9-c8db-4cd3-8188-9bce10bddd1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:58.981798 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f32e90d9-c8db-4cd3-8188-9bce10bddd1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:58.997074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f32e90d9-c8db-4cd3-8188-9bce10bddd1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:58.999096 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f32e90d9-c8db-4cd3-8188-9bce10bddd1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:59.003546 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f32e90d9-c8db-4cd3-8188-9bce10bddd1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:59.004307 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f32e90d9-c8db-4cd3-8188-9bce10bddd1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:59.251407 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e10c14b2-5eb7-45cb-a701-273d05076feb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:59.262547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f32e90d9-c8db-4cd3-8188-9bce10bddd1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:59.275987 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e10c14b2-5eb7-45cb-a701-273d05076feb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1249 microversion: 2.1 time: 0.818524 Jun 27 15:28:59.281240 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 164/322] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:58 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1249 bytes in 826 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:28:59.289547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f32e90d9-c8db-4cd3-8188-9bce10bddd1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:59.297914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f32e90d9-c8db-4cd3-8188-9bce10bddd1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:59.302659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f32e90d9-c8db-4cd3-8188-9bce10bddd1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.328630 Jun 27 15:28:59.304214 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 159/323] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:28:58 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:28:59.579966 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c0812c43-05ae-4aea-89a3-5e1b9e00d234 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:59.581462 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c0812c43-05ae-4aea-89a3-5e1b9e00d234 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:28:59.603956 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0812c43-05ae-4aea-89a3-5e1b9e00d234 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:59.608300 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0812c43-05ae-4aea-89a3-5e1b9e00d234 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:59.609478 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0812c43-05ae-4aea-89a3-5e1b9e00d234 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:59.610354 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0812c43-05ae-4aea-89a3-5e1b9e00d234 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:28:59.881232 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c0812c43-05ae-4aea-89a3-5e1b9e00d234 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:28:59.910836 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c0812c43-05ae-4aea-89a3-5e1b9e00d234 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1698 microversion: 2.1 time: 0.338136 Jun 27 15:28:59.937129 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 165/324] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:59 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1698 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:28:59.954699 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3e7ff0ec-c4fe-4dc7-9c0a-067914fb5f9c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:28:59.980354 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3e7ff0ec-c4fe-4dc7-9c0a-067914fb5f9c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:28:59.995194 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b92aad52-22a5-4464-9e07-4aa3a76d7824 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:28:59.996284 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b92aad52-22a5-4464-9e07-4aa3a76d7824 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:00.015587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3e7ff0ec-c4fe-4dc7-9c0a-067914fb5f9c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:00.044310 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b92aad52-22a5-4464-9e07-4aa3a76d7824 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:00.047900 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b92aad52-22a5-4464-9e07-4aa3a76d7824 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:00.054515 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b92aad52-22a5-4464-9e07-4aa3a76d7824 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:00.056005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b92aad52-22a5-4464-9e07-4aa3a76d7824 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:00.218466 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3e7ff0ec-c4fe-4dc7-9c0a-067914fb5f9c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Going to try to start instance {{(pid=117977) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 15:29:00.288802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b92aad52-22a5-4464-9e07-4aa3a76d7824 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:00.312065 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b92aad52-22a5-4464-9e07-4aa3a76d7824 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1310 microversion: 2.1 time: 0.324151 Jun 27 15:29:00.318888 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 166/325] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:28:59 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1310 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:00.335575 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-55c1156c-2eaa-404e-b22d-eb46378440f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:00.337525 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-55c1156c-2eaa-404e-b22d-eb46378440f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:00.356803 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-55c1156c-2eaa-404e-b22d-eb46378440f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:00.357537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-55c1156c-2eaa-404e-b22d-eb46378440f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:00.358853 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-55c1156c-2eaa-404e-b22d-eb46378440f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:00.359555 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-55c1156c-2eaa-404e-b22d-eb46378440f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:00.573189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-55c1156c-2eaa-404e-b22d-eb46378440f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:00.587894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-55c1156c-2eaa-404e-b22d-eb46378440f7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1315 microversion: 2.1 time: 0.265770 Jun 27 15:29:00.607448 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 167/326] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:00 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:00.617186 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5d8e0f3c-dabf-4e66-ab9c-3a60492c9fda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:00.618173 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5d8e0f3c-dabf-4e66-ab9c-3a60492c9fda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:00.626828 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d8e0f3c-dabf-4e66-ab9c-3a60492c9fda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:00.627621 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d8e0f3c-dabf-4e66-ab9c-3a60492c9fda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:00.629103 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d8e0f3c-dabf-4e66-ab9c-3a60492c9fda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:00.629888 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d8e0f3c-dabf-4e66-ab9c-3a60492c9fda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:00.795543 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3e7ff0ec-c4fe-4dc7-9c0a-067914fb5f9c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/action" status: 202 len: 0 microversion: 2.1 time: 0.846740 Jun 27 15:29:00.797370 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 160/327] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:28:59 2022] POST /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/action => generated 0 bytes in 852 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:29:00.815444 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-abe4e042-4786-4bed-8f88-87b339dcd4b4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:00.817691 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-abe4e042-4786-4bed-8f88-87b339dcd4b4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:00.838137 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abe4e042-4786-4bed-8f88-87b339dcd4b4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:00.840251 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abe4e042-4786-4bed-8f88-87b339dcd4b4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:00.842231 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abe4e042-4786-4bed-8f88-87b339dcd4b4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:00.844748 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abe4e042-4786-4bed-8f88-87b339dcd4b4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:00.980204 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5d8e0f3c-dabf-4e66-ab9c-3a60492c9fda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:01.019628 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5d8e0f3c-dabf-4e66-ab9c-3a60492c9fda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:01.022820 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5d8e0f3c-dabf-4e66-ab9c-3a60492c9fda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:01.025791 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5d8e0f3c-dabf-4e66-ab9c-3a60492c9fda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.415679 Jun 27 15:29:01.027206 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 168/328] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:00 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:01.337042 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-db2a2ed0-c5e9-4816-a4d3-8bec711b12cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:01.338136 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-db2a2ed0-c5e9-4816-a4d3-8bec711b12cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:01.378516 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db2a2ed0-c5e9-4816-a4d3-8bec711b12cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:01.379314 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db2a2ed0-c5e9-4816-a4d3-8bec711b12cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:01.380834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db2a2ed0-c5e9-4816-a4d3-8bec711b12cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:01.381566 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db2a2ed0-c5e9-4816-a4d3-8bec711b12cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:01.414632 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-abe4e042-4786-4bed-8f88-87b339dcd4b4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:01.424987 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-abe4e042-4786-4bed-8f88-87b339dcd4b4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1707 microversion: 2.1 time: 0.621768 Jun 27 15:29:01.434256 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 161/329] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:00 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1707 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:01.606915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ffaf3ca4-ff39-4c83-94de-579efaf835b1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:01.609988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ffaf3ca4-ff39-4c83-94de-579efaf835b1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:01.612890 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-db2a2ed0-c5e9-4816-a4d3-8bec711b12cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:01.636603 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ffaf3ca4-ff39-4c83-94de-579efaf835b1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:01.641655 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ffaf3ca4-ff39-4c83-94de-579efaf835b1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:01.643737 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ffaf3ca4-ff39-4c83-94de-579efaf835b1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:01.644354 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ffaf3ca4-ff39-4c83-94de-579efaf835b1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:01.666756 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-db2a2ed0-c5e9-4816-a4d3-8bec711b12cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1316 microversion: 2.1 time: 0.339383 Jun 27 15:29:01.676900 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 169/330] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:01 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1316 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:02.070076 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ce2a7678-582a-4361-89cf-e7f1d7f71595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:02.081313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ce2a7678-582a-4361-89cf-e7f1d7f71595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:02.092221 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce2a7678-582a-4361-89cf-e7f1d7f71595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:02.095270 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce2a7678-582a-4361-89cf-e7f1d7f71595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:02.100087 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce2a7678-582a-4361-89cf-e7f1d7f71595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:02.105508 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ce2a7678-582a-4361-89cf-e7f1d7f71595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:02.286593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ffaf3ca4-ff39-4c83-94de-579efaf835b1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:02.296343 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ffaf3ca4-ff39-4c83-94de-579efaf835b1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1303 microversion: 2.1 time: 0.694561 Jun 27 15:29:02.297138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 162/331] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:01 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1303 bytes in 696 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:02.458415 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f2679bdc-924b-47ec-a07a-576a43412dd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:02.459234 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f2679bdc-924b-47ec-a07a-576a43412dd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:02.479511 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f2679bdc-924b-47ec-a07a-576a43412dd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:02.479511 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f2679bdc-924b-47ec-a07a-576a43412dd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:02.479865 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f2679bdc-924b-47ec-a07a-576a43412dd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:02.493572 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f2679bdc-924b-47ec-a07a-576a43412dd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:02.787124 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ce2a7678-582a-4361-89cf-e7f1d7f71595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:02.824526 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ce2a7678-582a-4361-89cf-e7f1d7f71595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:02.834856 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ce2a7678-582a-4361-89cf-e7f1d7f71595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:02.837685 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ce2a7678-582a-4361-89cf-e7f1d7f71595 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.783176 Jun 27 15:29:02.857407 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 170/332] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:02 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 804 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:29:02.868562 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8984a63f-7839-4215-89f6-a7a3ce74265b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:02.870541 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8984a63f-7839-4215-89f6-a7a3ce74265b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:02.884252 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8984a63f-7839-4215-89f6-a7a3ce74265b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:02.885175 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8984a63f-7839-4215-89f6-a7a3ce74265b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:02.886338 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8984a63f-7839-4215-89f6-a7a3ce74265b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:02.887014 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8984a63f-7839-4215-89f6-a7a3ce74265b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:03.135649 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8984a63f-7839-4215-89f6-a7a3ce74265b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:03.148427 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8984a63f-7839-4215-89f6-a7a3ce74265b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.288649 Jun 27 15:29:03.149165 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 171/333] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:02 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:03.315064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-13d532ff-87e6-47d3-a4b0-3db283369d26 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:03.319025 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-13d532ff-87e6-47d3-a4b0-3db283369d26 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:03.341514 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13d532ff-87e6-47d3-a4b0-3db283369d26 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:03.341514 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13d532ff-87e6-47d3-a4b0-3db283369d26 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:03.342045 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13d532ff-87e6-47d3-a4b0-3db283369d26 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:03.342488 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13d532ff-87e6-47d3-a4b0-3db283369d26 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:03.503690 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-13d532ff-87e6-47d3-a4b0-3db283369d26 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:03.516720 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-13d532ff-87e6-47d3-a4b0-3db283369d26 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1303 microversion: 2.1 time: 0.205769 Jun 27 15:29:03.517400 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 172/334] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:03 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1303 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:03.558221 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f2679bdc-924b-47ec-a07a-576a43412dd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:03.579466 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f2679bdc-924b-47ec-a07a-576a43412dd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1707 microversion: 2.1 time: 1.123637 Jun 27 15:29:03.582689 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 163/335] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:02 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1707 bytes in 1127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:03.878858 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-52eae85a-840f-40ae-9546-c583260b1eef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:03.881447 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-52eae85a-840f-40ae-9546-c583260b1eef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:03.909925 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52eae85a-840f-40ae-9546-c583260b1eef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:03.921635 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52eae85a-840f-40ae-9546-c583260b1eef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:03.925392 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52eae85a-840f-40ae-9546-c583260b1eef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:03.926736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-52eae85a-840f-40ae-9546-c583260b1eef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:04.170507 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ca128ce9-a435-4539-bbca-2fa6cb137ac5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:04.171510 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ca128ce9-a435-4539-bbca-2fa6cb137ac5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:04.241747 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ca128ce9-a435-4539-bbca-2fa6cb137ac5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:04.249659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ca128ce9-a435-4539-bbca-2fa6cb137ac5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:04.258313 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ca128ce9-a435-4539-bbca-2fa6cb137ac5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:04.273611 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ca128ce9-a435-4539-bbca-2fa6cb137ac5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:04.431762 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-52eae85a-840f-40ae-9546-c583260b1eef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:04.450764 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-52eae85a-840f-40ae-9546-c583260b1eef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:04.455691 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-52eae85a-840f-40ae-9546-c583260b1eef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:04.460524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-52eae85a-840f-40ae-9546-c583260b1eef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.595387 Jun 27 15:29:04.477267 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 173/336] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:03 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:04.548086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a4ba9d4a-430a-4d1c-bd82-dc7dc4e80270 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:04.549611 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a4ba9d4a-430a-4d1c-bd82-dc7dc4e80270 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:04.561912 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4ba9d4a-430a-4d1c-bd82-dc7dc4e80270 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:04.562370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4ba9d4a-430a-4d1c-bd82-dc7dc4e80270 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:04.568371 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4ba9d4a-430a-4d1c-bd82-dc7dc4e80270 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:04.568860 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a4ba9d4a-430a-4d1c-bd82-dc7dc4e80270 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:04.948207 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a4ba9d4a-430a-4d1c-bd82-dc7dc4e80270 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:04.962717 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a4ba9d4a-430a-4d1c-bd82-dc7dc4e80270 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1370 microversion: 2.1 time: 0.419375 Jun 27 15:29:04.969162 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 174/337] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:04 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1370 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:04.975631 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ff842e87-905b-432f-a94a-270f5ffc9e57 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:04.980734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ff842e87-905b-432f-a94a-270f5ffc9e57 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:04.997095 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff842e87-905b-432f-a94a-270f5ffc9e57 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:05.001057 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff842e87-905b-432f-a94a-270f5ffc9e57 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:05.009017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff842e87-905b-432f-a94a-270f5ffc9e57 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:05.009589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff842e87-905b-432f-a94a-270f5ffc9e57 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:05.242302 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ca128ce9-a435-4539-bbca-2fa6cb137ac5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:05.256497 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ca128ce9-a435-4539-bbca-2fa6cb137ac5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 1.093732 Jun 27 15:29:05.261257 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 164/338] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:04 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 1100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:05.464442 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ff842e87-905b-432f-a94a-270f5ffc9e57 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:05.492371 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ff842e87-905b-432f-a94a-270f5ffc9e57 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1711 microversion: 2.1 time: 0.521228 Jun 27 15:29:05.494604 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 175/339] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:04 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1711 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:05.517186 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8b65716f-0ef4-4cb5-b34c-751dbe7c70cc tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:05.519045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8b65716f-0ef4-4cb5-b34c-751dbe7c70cc tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:05.536381 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8b65716f-0ef4-4cb5-b34c-751dbe7c70cc tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:05.537779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8b65716f-0ef4-4cb5-b34c-751dbe7c70cc tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:05.541836 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8b65716f-0ef4-4cb5-b34c-751dbe7c70cc tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:05.551680 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8b65716f-0ef4-4cb5-b34c-751dbe7c70cc tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:05.993177 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2a1522ff-4859-493f-9861-74d139c4e151 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:05.994082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2a1522ff-4859-493f-9861-74d139c4e151 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:06.012982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a1522ff-4859-493f-9861-74d139c4e151 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:06.013977 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a1522ff-4859-493f-9861-74d139c4e151 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:06.015044 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a1522ff-4859-493f-9861-74d139c4e151 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:06.015922 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2a1522ff-4859-493f-9861-74d139c4e151 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:06.377480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-8b65716f-0ef4-4cb5-b34c-751dbe7c70cc tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:06.401581 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-8b65716f-0ef4-4cb5-b34c-751dbe7c70cc tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:06.424468 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-8b65716f-0ef4-4cb5-b34c-751dbe7c70cc tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:06.435940 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8b65716f-0ef4-4cb5-b34c-751dbe7c70cc tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.949628 Jun 27 15:29:06.444710 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 165/340] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:05 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:29:06.445027 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2a1522ff-4859-493f-9861-74d139c4e151 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:06.470904 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2a1522ff-4859-493f-9861-74d139c4e151 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1370 microversion: 2.1 time: 0.481744 Jun 27 15:29:06.471752 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 176/341] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:05 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1370 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:06.475372 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4cf420c2-9aa0-4544-b2ba-9c51b31567f2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:06.477247 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4cf420c2-9aa0-4544-b2ba-9c51b31567f2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:06.485743 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4cf420c2-9aa0-4544-b2ba-9c51b31567f2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:06.486906 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4cf420c2-9aa0-4544-b2ba-9c51b31567f2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:06.488059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4cf420c2-9aa0-4544-b2ba-9c51b31567f2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:06.488813 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4cf420c2-9aa0-4544-b2ba-9c51b31567f2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:06.676726 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:07.119225 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4cf420c2-9aa0-4544-b2ba-9c51b31567f2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:07.139380 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4cf420c2-9aa0-4544-b2ba-9c51b31567f2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.688265 Jun 27 15:29:07.139977 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 166/342] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:06 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:07.476258 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9396042-e733-4845-add9-c427dadc19c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:07.486739 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9396042-e733-4845-add9-c427dadc19c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:07.498043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-86888168-9e8f-4fee-91e3-bb52418460c4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:07.501860 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-86888168-9e8f-4fee-91e3-bb52418460c4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:07.520433 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:07.522651 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-86888168-9e8f-4fee-91e3-bb52418460c4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:07.524242 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=10 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:07.525480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-86888168-9e8f-4fee-91e3-bb52418460c4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:07.529168 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-86888168-9e8f-4fee-91e3-bb52418460c4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:07.530189 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-86888168-9e8f-4fee-91e3-bb52418460c4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:07.531444 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9396042-e733-4845-add9-c427dadc19c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:07.536925 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9396042-e733-4845-add9-c427dadc19c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:07.554303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9396042-e733-4845-add9-c427dadc19c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:07.560027 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9396042-e733-4845-add9-c427dadc19c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:07.648219 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:07.712061 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=14 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:08.041863 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9396042-e733-4845-add9-c427dadc19c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:08.054700 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9396042-e733-4845-add9-c427dadc19c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:08.066043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9396042-e733-4845-add9-c427dadc19c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:08.067342 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9396042-e733-4845-add9-c427dadc19c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.605545 Jun 27 15:29:08.068224 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 177/343] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:07 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:08.117775 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-80a96eb9-cd8e-4b4a-91f7-2d665c14e627 req-511fd3e1-56f7-4c36-bbbe-cda8c2364233 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5aa595-85d6-44d8-9b6a-0fd0e958657c", "tag": "3ccbca6d-373a-42a6-9d88-221bb0b77dd5"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:08.137455 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-80a96eb9-cd8e-4b4a-91f7-2d665c14e627 req-511fd3e1-56f7-4c36-bbbe-cda8c2364233 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:08.137899 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-80a96eb9-cd8e-4b4a-91f7-2d665c14e627 req-511fd3e1-56f7-4c36-bbbe-cda8c2364233 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:08.167545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-80a96eb9-cd8e-4b4a-91f7-2d665c14e627 req-511fd3e1-56f7-4c36-bbbe-cda8c2364233 service nova] Creating event network-changed:3ccbca6d-373a-42a6-9d88-221bb0b77dd5 for instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c on hv-cinder-84779 Jun 27 15:29:08.189948 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-80a96eb9-cd8e-4b4a-91f7-2d665c14e627 req-511fd3e1-56f7-4c36-bbbe-cda8c2364233 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076403 Jun 27 15:29:08.190654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 178/344] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:29:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:29:08.203879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3755dd04-feeb-4c72-a0da-172d78a46e2c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:08.211494 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3755dd04-feeb-4c72-a0da-172d78a46e2c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:08.227063 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3755dd04-feeb-4c72-a0da-172d78a46e2c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:08.227518 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3755dd04-feeb-4c72-a0da-172d78a46e2c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:08.228350 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3755dd04-feeb-4c72-a0da-172d78a46e2c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:08.228790 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3755dd04-feeb-4c72-a0da-172d78a46e2c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:08.480698 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-86888168-9e8f-4fee-91e3-bb52418460c4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:08.514346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-86888168-9e8f-4fee-91e3-bb52418460c4 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1370 microversion: 2.1 time: 1.015436 Jun 27 15:29:08.538003 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 167/345] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:07 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1370 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:08.588435 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3755dd04-feeb-4c72-a0da-172d78a46e2c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:08.622598 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3755dd04-feeb-4c72-a0da-172d78a46e2c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.430202 Jun 27 15:29:08.641934 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 179/346] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:08 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:09.087013 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ab7dcece-dfeb-4b7f-a01d-e3a12b789f63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:09.087970 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ab7dcece-dfeb-4b7f-a01d-e3a12b789f63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:09.102238 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab7dcece-dfeb-4b7f-a01d-e3a12b789f63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:09.104032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab7dcece-dfeb-4b7f-a01d-e3a12b789f63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:09.112403 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab7dcece-dfeb-4b7f-a01d-e3a12b789f63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:09.113323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab7dcece-dfeb-4b7f-a01d-e3a12b789f63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:09.556492 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-92b2e532-5dd0-4bb7-804b-12efff39fd29 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:09.558501 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-92b2e532-5dd0-4bb7-804b-12efff39fd29 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:09.574694 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-92b2e532-5dd0-4bb7-804b-12efff39fd29 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:09.579943 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-92b2e532-5dd0-4bb7-804b-12efff39fd29 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:09.584917 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-92b2e532-5dd0-4bb7-804b-12efff39fd29 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:09.586718 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-92b2e532-5dd0-4bb7-804b-12efff39fd29 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:10.048842 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-92b2e532-5dd0-4bb7-804b-12efff39fd29 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:10.097140 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-92b2e532-5dd0-4bb7-804b-12efff39fd29 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1370 microversion: 2.1 time: 0.554067 Jun 27 15:29:10.119998 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 180/347] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:09 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1370 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:10.125872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2957445e-8194-472e-b5d6-cfece4fc54ca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:10.126623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2957445e-8194-472e-b5d6-cfece4fc54ca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:10.160930 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2957445e-8194-472e-b5d6-cfece4fc54ca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:10.161377 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2957445e-8194-472e-b5d6-cfece4fc54ca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:10.162398 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2957445e-8194-472e-b5d6-cfece4fc54ca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:10.163047 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2957445e-8194-472e-b5d6-cfece4fc54ca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:10.475205 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ab7dcece-dfeb-4b7f-a01d-e3a12b789f63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:10.498820 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ab7dcece-dfeb-4b7f-a01d-e3a12b789f63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:10.500622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ab7dcece-dfeb-4b7f-a01d-e3a12b789f63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:10.502471 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ab7dcece-dfeb-4b7f-a01d-e3a12b789f63 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 1.420154 Jun 27 15:29:10.515777 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 168/348] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:09 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 1434 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:10.521187 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-bb8d8e16-cf66-489a-934c-1d09551b6bd2 req-08b7ff37-c621-472a-901e-d497c485de1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b96384b-617e-4ae6-989b-f16e60189883", "tag": "44036d57-a43c-4cb8-b4e7-dad2d8ab154a"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:10.532650 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-bb8d8e16-cf66-489a-934c-1d09551b6bd2 req-08b7ff37-c621-472a-901e-d497c485de1f service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:10.533430 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-bb8d8e16-cf66-489a-934c-1d09551b6bd2 req-08b7ff37-c621-472a-901e-d497c485de1f service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:10.561026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-bb8d8e16-cf66-489a-934c-1d09551b6bd2 req-08b7ff37-c621-472a-901e-d497c485de1f service nova] Creating event network-changed:44036d57-a43c-4cb8-b4e7-dad2d8ab154a for instance 6b96384b-617e-4ae6-989b-f16e60189883 on hv-cinder-84779 Jun 27 15:29:10.566914 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2957445e-8194-472e-b5d6-cfece4fc54ca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:10.568942 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-bb8d8e16-cf66-489a-934c-1d09551b6bd2 req-08b7ff37-c621-472a-901e-d497c485de1f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051479 Jun 27 15:29:10.569780 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 169/349] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:29:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:29:10.581303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2957445e-8194-472e-b5d6-cfece4fc54ca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.457353 Jun 27 15:29:10.583736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 181/350] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:10 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:11.122868 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-367de5de-ac05-49c2-a087-4d4c8913e10f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:11.125300 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-367de5de-ac05-49c2-a087-4d4c8913e10f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:11.150316 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-367de5de-ac05-49c2-a087-4d4c8913e10f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:11.151293 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-367de5de-ac05-49c2-a087-4d4c8913e10f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:11.152691 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-367de5de-ac05-49c2-a087-4d4c8913e10f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:11.153422 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-367de5de-ac05-49c2-a087-4d4c8913e10f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:11.544217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-486a0ca3-c185-48cc-ba06-7c538ab86bf9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:11.547512 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-486a0ca3-c185-48cc-ba06-7c538ab86bf9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:11.569000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-486a0ca3-c185-48cc-ba06-7c538ab86bf9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:11.571137 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-486a0ca3-c185-48cc-ba06-7c538ab86bf9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:11.574129 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-486a0ca3-c185-48cc-ba06-7c538ab86bf9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:11.578368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-486a0ca3-c185-48cc-ba06-7c538ab86bf9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:12.065103 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-486a0ca3-c185-48cc-ba06-7c538ab86bf9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:12.104627 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-486a0ca3-c185-48cc-ba06-7c538ab86bf9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:12.112878 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-486a0ca3-c185-48cc-ba06-7c538ab86bf9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:12.118848 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-486a0ca3-c185-48cc-ba06-7c538ab86bf9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 0.586295 Jun 27 15:29:12.124464 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 182/351] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:11 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:12.140960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-17cd5524-f41d-4569-a01b-78b3f8fae30e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:12.143805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-17cd5524-f41d-4569-a01b-78b3f8fae30e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:12.184382 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17cd5524-f41d-4569-a01b-78b3f8fae30e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:12.187126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17cd5524-f41d-4569-a01b-78b3f8fae30e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:12.198991 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17cd5524-f41d-4569-a01b-78b3f8fae30e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:12.205374 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-17cd5524-f41d-4569-a01b-78b3f8fae30e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:12.328477 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-367de5de-ac05-49c2-a087-4d4c8913e10f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:12.382108 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-367de5de-ac05-49c2-a087-4d4c8913e10f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1370 microversion: 2.1 time: 1.268945 Jun 27 15:29:12.412572 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 170/352] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:11 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1370 bytes in 1301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:12.572923 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-17cd5524-f41d-4569-a01b-78b3f8fae30e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:12.589100 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-17cd5524-f41d-4569-a01b-78b3f8fae30e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.461129 Jun 27 15:29:12.590752 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 183/353] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:12 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:13.144803 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-385265f0-49c7-4414-a422-5940a2209a80 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:13.146394 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-385265f0-49c7-4414-a422-5940a2209a80 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:13.166162 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-385265f0-49c7-4414-a422-5940a2209a80 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:13.167206 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-385265f0-49c7-4414-a422-5940a2209a80 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:13.169117 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-385265f0-49c7-4414-a422-5940a2209a80 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:13.170482 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-385265f0-49c7-4414-a422-5940a2209a80 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:13.437506 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c528fbce-cd5f-41f9-aac7-1ada985825a2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:13.439419 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c528fbce-cd5f-41f9-aac7-1ada985825a2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:13.466017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c528fbce-cd5f-41f9-aac7-1ada985825a2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:13.471479 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c528fbce-cd5f-41f9-aac7-1ada985825a2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:13.476810 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c528fbce-cd5f-41f9-aac7-1ada985825a2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:13.478788 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c528fbce-cd5f-41f9-aac7-1ada985825a2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:14.108118 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c528fbce-cd5f-41f9-aac7-1ada985825a2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:14.119305 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-385265f0-49c7-4414-a422-5940a2209a80 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:14.178044 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c528fbce-cd5f-41f9-aac7-1ada985825a2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1370 microversion: 2.1 time: 0.764361 Jun 27 15:29:14.185390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 184/354] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:13 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1370 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:14.190944 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-385265f0-49c7-4414-a422-5940a2209a80 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:14.213867 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-385265f0-49c7-4414-a422-5940a2209a80 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:14.216009 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-385265f0-49c7-4414-a422-5940a2209a80 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1738 microversion: 2.20 time: 1.079920 Jun 27 15:29:14.219077 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ba122029-97a6-4efc-8d6e-38ab785be9c9 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:14.220129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 171/355] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:13 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1738 bytes in 1085 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:14.221733 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ba122029-97a6-4efc-8d6e-38ab785be9c9 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:14.230917 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba122029-97a6-4efc-8d6e-38ab785be9c9 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:14.231757 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba122029-97a6-4efc-8d6e-38ab785be9c9 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:14.233470 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba122029-97a6-4efc-8d6e-38ab785be9c9 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:14.234339 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ba122029-97a6-4efc-8d6e-38ab785be9c9 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:14.589940 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ba122029-97a6-4efc-8d6e-38ab785be9c9 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:14.615218 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ba122029-97a6-4efc-8d6e-38ab785be9c9 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.417374 Jun 27 15:29:14.616774 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 185/356] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:14 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:15.215122 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-54325f92-a5dd-413d-a002-e12926b04b69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:15.216742 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-54325f92-a5dd-413d-a002-e12926b04b69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:15.229316 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-54325f92-a5dd-413d-a002-e12926b04b69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:15.229659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-54325f92-a5dd-413d-a002-e12926b04b69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:15.233555 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-54325f92-a5dd-413d-a002-e12926b04b69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:15.235196 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-54325f92-a5dd-413d-a002-e12926b04b69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:15.252668 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1f46ea93-de63-4c8d-8f4c-cb453a725693 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:15.256563 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1f46ea93-de63-4c8d-8f4c-cb453a725693 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:15.286991 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1f46ea93-de63-4c8d-8f4c-cb453a725693 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:15.289521 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1f46ea93-de63-4c8d-8f4c-cb453a725693 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:15.290750 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1f46ea93-de63-4c8d-8f4c-cb453a725693 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:15.291354 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1f46ea93-de63-4c8d-8f4c-cb453a725693 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:15.585039 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-54325f92-a5dd-413d-a002-e12926b04b69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:15.588686 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-54325f92-a5dd-413d-a002-e12926b04b69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1370 microversion: 2.1 time: 0.378536 Jun 27 15:29:15.600551 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 172/357] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:15 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1370 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:15.640397 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9b592d55-d5ad-458a-abf0-8e4a04a98699 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:15.644717 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9b592d55-d5ad-458a-abf0-8e4a04a98699 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:15.658539 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b592d55-d5ad-458a-abf0-8e4a04a98699 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:15.665745 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b592d55-d5ad-458a-abf0-8e4a04a98699 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:15.667179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b592d55-d5ad-458a-abf0-8e4a04a98699 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:15.667897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b592d55-d5ad-458a-abf0-8e4a04a98699 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:15.746955 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1f46ea93-de63-4c8d-8f4c-cb453a725693 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:15.760057 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1f46ea93-de63-4c8d-8f4c-cb453a725693 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:15.774522 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1f46ea93-de63-4c8d-8f4c-cb453a725693 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:15.776155 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1f46ea93-de63-4c8d-8f4c-cb453a725693 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1720 microversion: 2.20 time: 0.539795 Jun 27 15:29:15.777368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 186/358] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:15 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1720 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:16.004492 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9b592d55-d5ad-458a-abf0-8e4a04a98699 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:16.027960 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9b592d55-d5ad-458a-abf0-8e4a04a98699 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.391477 Jun 27 15:29:16.045076 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 173/359] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:15 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:16.072256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-a351deb0-e16e-4f87-8378-ac63693b6351 req-c076914d-f172-4cbf-967b-08c39bf54854 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b96384b-617e-4ae6-989b-f16e60189883", "name": "network-vif-plugged", "status": "completed", "tag": "44036d57-a43c-4cb8-b4e7-dad2d8ab154a"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:16.086588 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a351deb0-e16e-4f87-8378-ac63693b6351 req-c076914d-f172-4cbf-967b-08c39bf54854 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:16.087659 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a351deb0-e16e-4f87-8378-ac63693b6351 req-c076914d-f172-4cbf-967b-08c39bf54854 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:16.126283 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-a351deb0-e16e-4f87-8378-ac63693b6351 req-c076914d-f172-4cbf-967b-08c39bf54854 service nova] Creating event network-vif-plugged:44036d57-a43c-4cb8-b4e7-dad2d8ab154a for instance 6b96384b-617e-4ae6-989b-f16e60189883 on hv-cinder-84779 Jun 27 15:29:16.137061 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-a351deb0-e16e-4f87-8378-ac63693b6351 req-c076914d-f172-4cbf-967b-08c39bf54854 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070227 Jun 27 15:29:16.138660 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 187/360] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:29:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:29:16.611735 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-50b87968-3047-467e-a833-786c3aa130ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:16.612602 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-50b87968-3047-467e-a833-786c3aa130ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:16.621366 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-50b87968-3047-467e-a833-786c3aa130ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:16.622371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-50b87968-3047-467e-a833-786c3aa130ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:16.623589 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-50b87968-3047-467e-a833-786c3aa130ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:16.624139 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-50b87968-3047-467e-a833-786c3aa130ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:16.648630 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:16.809076 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-91225849-3b72-4d2e-9f8f-0d482162ba03 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:16.811527 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-91225849-3b72-4d2e-9f8f-0d482162ba03 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:16.825017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91225849-3b72-4d2e-9f8f-0d482162ba03 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:16.826347 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91225849-3b72-4d2e-9f8f-0d482162ba03 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:16.828038 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91225849-3b72-4d2e-9f8f-0d482162ba03 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:16.829139 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-91225849-3b72-4d2e-9f8f-0d482162ba03 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:16.887969 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-50b87968-3047-467e-a833-786c3aa130ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:16.905388 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-50b87968-3047-467e-a833-786c3aa130ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1370 microversion: 2.1 time: 0.298594 Jun 27 15:29:16.907192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 174/361] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:16 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1370 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:17.058458 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d4500f1d-1b98-4e7b-8d7c-9d2bba2ecba2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:17.059455 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d4500f1d-1b98-4e7b-8d7c-9d2bba2ecba2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:17.073380 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4500f1d-1b98-4e7b-8d7c-9d2bba2ecba2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:17.074184 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4500f1d-1b98-4e7b-8d7c-9d2bba2ecba2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:17.075189 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4500f1d-1b98-4e7b-8d7c-9d2bba2ecba2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:17.075800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4500f1d-1b98-4e7b-8d7c-9d2bba2ecba2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:17.167067 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-91225849-3b72-4d2e-9f8f-0d482162ba03 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:17.185288 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-91225849-3b72-4d2e-9f8f-0d482162ba03 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:17.188952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-91225849-3b72-4d2e-9f8f-0d482162ba03 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:17.191578 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-91225849-3b72-4d2e-9f8f-0d482162ba03 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1720 microversion: 2.20 time: 0.391983 Jun 27 15:29:17.193209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 188/362] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:16 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1720 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:17.324606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d4500f1d-1b98-4e7b-8d7c-9d2bba2ecba2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:17.343777 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d4500f1d-1b98-4e7b-8d7c-9d2bba2ecba2 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.288910 Jun 27 15:29:17.344877 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 175/363] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:17 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:17.936187 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9fa86843-67fc-4f9e-a0c6-964682d5e267 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:17.937141 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9fa86843-67fc-4f9e-a0c6-964682d5e267 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:17.946892 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fa86843-67fc-4f9e-a0c6-964682d5e267 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:17.947352 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fa86843-67fc-4f9e-a0c6-964682d5e267 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:17.948159 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fa86843-67fc-4f9e-a0c6-964682d5e267 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:17.948632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fa86843-67fc-4f9e-a0c6-964682d5e267 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:18.160405 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9fa86843-67fc-4f9e-a0c6-964682d5e267 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:18.164117 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-ac0eb674-8c11-4cb6-a4b8-e58b344d74f8 req-1d6698ee-3ca6-4556-9523-932ebceb936c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831291d0-f04d-4927-afcd-88fd058db642", "name": "network-vif-unplugged", "status": "completed", "tag": "62696634-23e0-4313-bcf8-d3be6665d3aa"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:18.174627 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9fa86843-67fc-4f9e-a0c6-964682d5e267 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1370 microversion: 2.1 time: 0.243312 Jun 27 15:29:18.175593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-ac0eb674-8c11-4cb6-a4b8-e58b344d74f8 req-1d6698ee-3ca6-4556-9523-932ebceb936c service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:18.175929 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 189/364] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:17 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1370 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:18.176061 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-ac0eb674-8c11-4cb6-a4b8-e58b344d74f8 req-1d6698ee-3ca6-4556-9523-932ebceb936c service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:18.190463 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-ac0eb674-8c11-4cb6-a4b8-e58b344d74f8 req-1d6698ee-3ca6-4556-9523-932ebceb936c service nova] Creating event network-vif-unplugged:62696634-23e0-4313-bcf8-d3be6665d3aa for instance 831291d0-f04d-4927-afcd-88fd058db642 on hv-cinder-84779 Jun 27 15:29:18.201756 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-ac0eb674-8c11-4cb6-a4b8-e58b344d74f8 req-1d6698ee-3ca6-4556-9523-932ebceb936c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.042414 Jun 27 15:29:18.203034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 176/365] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:29:18 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:29:18.212906 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1b5266c9-0453-42a0-9db5-6afe7eea3303 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:18.213757 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1b5266c9-0453-42a0-9db5-6afe7eea3303 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:18.221908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b5266c9-0453-42a0-9db5-6afe7eea3303 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:18.222524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b5266c9-0453-42a0-9db5-6afe7eea3303 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:18.223400 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b5266c9-0453-42a0-9db5-6afe7eea3303 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:18.224226 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b5266c9-0453-42a0-9db5-6afe7eea3303 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:18.374859 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2903b6ce-4987-4d73-9d8a-b1c139e60de6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:18.376649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2903b6ce-4987-4d73-9d8a-b1c139e60de6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:18.392410 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2903b6ce-4987-4d73-9d8a-b1c139e60de6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:18.393948 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2903b6ce-4987-4d73-9d8a-b1c139e60de6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:18.398307 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2903b6ce-4987-4d73-9d8a-b1c139e60de6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:18.399797 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2903b6ce-4987-4d73-9d8a-b1c139e60de6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:18.457204 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1b5266c9-0453-42a0-9db5-6afe7eea3303 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:18.483374 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1b5266c9-0453-42a0-9db5-6afe7eea3303 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:18.487038 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1b5266c9-0453-42a0-9db5-6afe7eea3303 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:18.489671 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1b5266c9-0453-42a0-9db5-6afe7eea3303 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1723 microversion: 2.20 time: 0.281853 Jun 27 15:29:18.490693 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 190/366] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:18 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1723 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:29:18.517913 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-096a99ee-f12e-40e7-9fb4-de5cd4f9ce41 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9cfb74b5-8b17-49e4-9139-d0348dc74a10"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:18.519017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-096a99ee-f12e-40e7-9fb4-de5cd4f9ce41 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:18.526370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-096a99ee-f12e-40e7-9fb4-de5cd4f9ce41 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:18.526718 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-096a99ee-f12e-40e7-9fb4-de5cd4f9ce41 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:18.527543 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-096a99ee-f12e-40e7-9fb4-de5cd4f9ce41 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:18.527927 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-096a99ee-f12e-40e7-9fb4-de5cd4f9ce41 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:18.591335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2903b6ce-4987-4d73-9d8a-b1c139e60de6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:18.599876 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2903b6ce-4987-4d73-9d8a-b1c139e60de6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.238209 Jun 27 15:29:18.600873 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 177/367] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:18 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:19.014306 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-096a99ee-f12e-40e7-9fb4-de5cd4f9ce41 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "POST /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.499639 Jun 27 15:29:19.045353 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 191/368] 10.222.0.26 () {62 vars in 1363 bytes} [Mon Jun 27 15:29:18 2022] POST /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments => generated 188 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 15:29:19.202686 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-dfe41906-66c8-476a-8504-17660a7e6ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:19.204673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-dfe41906-66c8-476a-8504-17660a7e6ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:19.250220 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dfe41906-66c8-476a-8504-17660a7e6ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:19.251449 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dfe41906-66c8-476a-8504-17660a7e6ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:19.256099 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dfe41906-66c8-476a-8504-17660a7e6ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:19.257246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dfe41906-66c8-476a-8504-17660a7e6ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:19.337369 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ed994484-a050-4e02-abab-3d866d80a3cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:19.338597 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ed994484-a050-4e02-abab-3d866d80a3cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:19.361950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed994484-a050-4e02-abab-3d866d80a3cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:19.361950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed994484-a050-4e02-abab-3d866d80a3cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:19.361950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed994484-a050-4e02-abab-3d866d80a3cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:19.361950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed994484-a050-4e02-abab-3d866d80a3cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:19.447540 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:19.498851 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-dfe41906-66c8-476a-8504-17660a7e6ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:19.511692 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-dfe41906-66c8-476a-8504-17660a7e6ef2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1370 microversion: 2.1 time: 0.314147 Jun 27 15:29:19.515151 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ed994484-a050-4e02-abab-3d866d80a3cf tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "POST /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/action" status: 202 len: 0 microversion: 2.20 time: 0.189247 Jun 27 15:29:19.516122 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 192/369] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jun 27 15:29:19 2022] POST /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/action => generated 0 bytes in 191 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:29:19.526062 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 178/370] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:19 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1370 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:19.531300 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ac52139e-4163-4574-aa1c-a4bc7d945334 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:19.532172 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ac52139e-4163-4574-aa1c-a4bc7d945334 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:19.540667 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac52139e-4163-4574-aa1c-a4bc7d945334 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:19.541017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac52139e-4163-4574-aa1c-a4bc7d945334 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:19.541720 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac52139e-4163-4574-aa1c-a4bc7d945334 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:19.542212 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac52139e-4163-4574-aa1c-a4bc7d945334 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:19.624721 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ebc8c3cf-7eb5-4ac6-9bd7-7e2cbb29e1cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:19.625549 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ebc8c3cf-7eb5-4ac6-9bd7-7e2cbb29e1cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:19.666277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ebc8c3cf-7eb5-4ac6-9bd7-7e2cbb29e1cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:19.675735 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ebc8c3cf-7eb5-4ac6-9bd7-7e2cbb29e1cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:19.678844 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ebc8c3cf-7eb5-4ac6-9bd7-7e2cbb29e1cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:19.679683 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ebc8c3cf-7eb5-4ac6-9bd7-7e2cbb29e1cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:19.907952 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ebc8c3cf-7eb5-4ac6-9bd7-7e2cbb29e1cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:19.918178 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ebc8c3cf-7eb5-4ac6-9bd7-7e2cbb29e1cf tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.297770 Jun 27 15:29:19.919331 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 179/371] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:19 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:19.952769 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ac52139e-4163-4574-aa1c-a4bc7d945334 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:19.964172 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ac52139e-4163-4574-aa1c-a4bc7d945334 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:19.966364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ac52139e-4163-4574-aa1c-a4bc7d945334 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:19.968621 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ac52139e-4163-4574-aa1c-a4bc7d945334 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.441456 Jun 27 15:29:19.981183 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 193/372] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:19 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:29:20.530142 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3ac18ead-faa8-4153-a7c4-cadf31ab6072 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:20.531067 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3ac18ead-faa8-4153-a7c4-cadf31ab6072 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:20.538701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3ac18ead-faa8-4153-a7c4-cadf31ab6072 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:20.539548 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3ac18ead-faa8-4153-a7c4-cadf31ab6072 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:20.540889 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3ac18ead-faa8-4153-a7c4-cadf31ab6072 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:20.541594 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3ac18ead-faa8-4153-a7c4-cadf31ab6072 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:20.794150 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3ac18ead-faa8-4153-a7c4-cadf31ab6072 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:20.809708 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3ac18ead-faa8-4153-a7c4-cadf31ab6072 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1563 microversion: 2.1 time: 0.283165 Jun 27 15:29:20.810606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 180/373] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:20 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1563 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:20.837145 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c4042da2-5a1f-43fe-98da-5b5765c7c17c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:20.837995 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c4042da2-5a1f-43fe-98da-5b5765c7c17c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:20.886104 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4042da2-5a1f-43fe-98da-5b5765c7c17c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:20.886669 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4042da2-5a1f-43fe-98da-5b5765c7c17c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:20.887494 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4042da2-5a1f-43fe-98da-5b5765c7c17c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:20.888021 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c4042da2-5a1f-43fe-98da-5b5765c7c17c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:20.947883 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4841ac41-bde9-4183-bed3-f15cadb62a8f tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:20.948675 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4841ac41-bde9-4183-bed3-f15cadb62a8f tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:20.961486 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4841ac41-bde9-4183-bed3-f15cadb62a8f tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:20.962032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4841ac41-bde9-4183-bed3-f15cadb62a8f tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:20.963340 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4841ac41-bde9-4183-bed3-f15cadb62a8f tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:20.964138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4841ac41-bde9-4183-bed3-f15cadb62a8f tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:21.108746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c4042da2-5a1f-43fe-98da-5b5765c7c17c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.277237 Jun 27 15:29:21.116560 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 194/374] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jun 27 15:29:20 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-interface => generated 284 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:29:21.134987 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-eed6efd1-dc9e-40a9-8b55-ba242a9a4fe9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:21.140193 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-eed6efd1-dc9e-40a9-8b55-ba242a9a4fe9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:21.149940 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eed6efd1-dc9e-40a9-8b55-ba242a9a4fe9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:21.151128 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eed6efd1-dc9e-40a9-8b55-ba242a9a4fe9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:21.153409 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eed6efd1-dc9e-40a9-8b55-ba242a9a4fe9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:21.154700 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eed6efd1-dc9e-40a9-8b55-ba242a9a4fe9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:21.467350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4841ac41-bde9-4183-bed3-f15cadb62a8f tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:21.502125 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4841ac41-bde9-4183-bed3-f15cadb62a8f tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.559409 Jun 27 15:29:21.511761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 181/375] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:20 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:21.750620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-eed6efd1-dc9e-40a9-8b55-ba242a9a4fe9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:21.764098 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-eed6efd1-dc9e-40a9-8b55-ba242a9a4fe9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:21.765743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-eed6efd1-dc9e-40a9-8b55-ba242a9a4fe9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:21.770317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-eed6efd1-dc9e-40a9-8b55-ba242a9a4fe9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.651228 Jun 27 15:29:21.770907 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 195/376] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:21 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:22.554019 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3143a931-3d48-47dc-b262-ccf5cd51ef49 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:22.561365 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3143a931-3d48-47dc-b262-ccf5cd51ef49 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:22.579459 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3143a931-3d48-47dc-b262-ccf5cd51ef49 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:22.580198 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3143a931-3d48-47dc-b262-ccf5cd51ef49 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:22.581056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3143a931-3d48-47dc-b262-ccf5cd51ef49 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:22.581491 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3143a931-3d48-47dc-b262-ccf5cd51ef49 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:22.753107 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3143a931-3d48-47dc-b262-ccf5cd51ef49 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:22.762406 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3143a931-3d48-47dc-b262-ccf5cd51ef49 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.232668 Jun 27 15:29:22.772778 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 182/377] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:22 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:22.800217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0fa5cd30-7231-42a8-9238-9b897697c544 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:22.805950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0fa5cd30-7231-42a8-9238-9b897697c544 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:22.856634 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0fa5cd30-7231-42a8-9238-9b897697c544 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:22.858196 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0fa5cd30-7231-42a8-9238-9b897697c544 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:22.863144 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0fa5cd30-7231-42a8-9238-9b897697c544 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:22.864565 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0fa5cd30-7231-42a8-9238-9b897697c544 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:23.034792 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-c10b19eb-cfec-4a3a-9f6d-9e6e2abe8431 req-c358cb80-de54-4cc2-8201-a88162d19e83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b96384b-617e-4ae6-989b-f16e60189883", "tag": "44036d57-a43c-4cb8-b4e7-dad2d8ab154a"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:23.062183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-c10b19eb-cfec-4a3a-9f6d-9e6e2abe8431 req-c358cb80-de54-4cc2-8201-a88162d19e83 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:23.062633 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-c10b19eb-cfec-4a3a-9f6d-9e6e2abe8431 req-c358cb80-de54-4cc2-8201-a88162d19e83 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:23.076056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-c10b19eb-cfec-4a3a-9f6d-9e6e2abe8431 req-c358cb80-de54-4cc2-8201-a88162d19e83 service nova] Creating event network-changed:44036d57-a43c-4cb8-b4e7-dad2d8ab154a for instance 6b96384b-617e-4ae6-989b-f16e60189883 on hv-cinder-84779 Jun 27 15:29:23.099737 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-c10b19eb-cfec-4a3a-9f6d-9e6e2abe8431 req-c358cb80-de54-4cc2-8201-a88162d19e83 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069216 Jun 27 15:29:23.100622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 183/378] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:29:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:29:23.217460 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0fa5cd30-7231-42a8-9238-9b897697c544 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:23.232214 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0fa5cd30-7231-42a8-9238-9b897697c544 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:23.237431 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0fa5cd30-7231-42a8-9238-9b897697c544 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:23.240236 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0fa5cd30-7231-42a8-9238-9b897697c544 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.451118 Jun 27 15:29:23.244384 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 196/379] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:22 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:23.785524 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-10f76a53-5e65-4796-afbb-345ea844cf11 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:23.789383 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-10f76a53-5e65-4796-afbb-345ea844cf11 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:23.799114 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-10f76a53-5e65-4796-afbb-345ea844cf11 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:23.801676 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-10f76a53-5e65-4796-afbb-345ea844cf11 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:23.802868 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-10f76a53-5e65-4796-afbb-345ea844cf11 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:23.803517 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-10f76a53-5e65-4796-afbb-345ea844cf11 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:24.250423 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-10f76a53-5e65-4796-afbb-345ea844cf11 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:24.276428 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-10f76a53-5e65-4796-afbb-345ea844cf11 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.499612 Jun 27 15:29:24.276797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b744ee4c-99b2-42d6-9d41-91a8d057974c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:24.277986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b744ee4c-99b2-42d6-9d41-91a8d057974c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:24.278393 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 184/380] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:23 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:24.297939 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b744ee4c-99b2-42d6-9d41-91a8d057974c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:24.298390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b744ee4c-99b2-42d6-9d41-91a8d057974c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:24.300241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b744ee4c-99b2-42d6-9d41-91a8d057974c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:24.301704 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b744ee4c-99b2-42d6-9d41-91a8d057974c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:24.525975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b744ee4c-99b2-42d6-9d41-91a8d057974c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:24.544978 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b744ee4c-99b2-42d6-9d41-91a8d057974c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:24.546502 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b744ee4c-99b2-42d6-9d41-91a8d057974c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:24.547761 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b744ee4c-99b2-42d6-9d41-91a8d057974c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.280662 Jun 27 15:29:24.548698 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 197/381] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:24 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:29:25.310785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c03ad488-14fc-48ee-942c-78acaadc7c91 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:25.312106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-c03ad488-14fc-48ee-942c-78acaadc7c91 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:25.326493 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c03ad488-14fc-48ee-942c-78acaadc7c91 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:25.327779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c03ad488-14fc-48ee-942c-78acaadc7c91 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:25.329548 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c03ad488-14fc-48ee-942c-78acaadc7c91 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:25.330634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c03ad488-14fc-48ee-942c-78acaadc7c91 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:25.573143 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-401ae269-78a1-48fe-8b53-eafab44b932a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:25.574587 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-401ae269-78a1-48fe-8b53-eafab44b932a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:25.575622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-c03ad488-14fc-48ee-942c-78acaadc7c91 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:25.587054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-401ae269-78a1-48fe-8b53-eafab44b932a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:25.588353 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-401ae269-78a1-48fe-8b53-eafab44b932a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:25.589728 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-401ae269-78a1-48fe-8b53-eafab44b932a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:25.590778 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-401ae269-78a1-48fe-8b53-eafab44b932a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:25.591104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c03ad488-14fc-48ee-942c-78acaadc7c91 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.287460 Jun 27 15:29:25.592597 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 185/382] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:25 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:25.815113 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-401ae269-78a1-48fe-8b53-eafab44b932a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:25.829312 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-401ae269-78a1-48fe-8b53-eafab44b932a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:25.833963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-401ae269-78a1-48fe-8b53-eafab44b932a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:25.836107 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-401ae269-78a1-48fe-8b53-eafab44b932a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.271058 Jun 27 15:29:25.837799 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 198/383] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:25 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:26.610227 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-28109108-efe7-4293-8bc9-8f687580daca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:26.612495 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-28109108-efe7-4293-8bc9-8f687580daca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:26.624274 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-28109108-efe7-4293-8bc9-8f687580daca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:26.625285 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-28109108-efe7-4293-8bc9-8f687580daca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:26.626464 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-28109108-efe7-4293-8bc9-8f687580daca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:26.627262 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-28109108-efe7-4293-8bc9-8f687580daca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:26.828237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-28109108-efe7-4293-8bc9-8f687580daca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:26.837179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-28109108-efe7-4293-8bc9-8f687580daca tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.231841 Jun 27 15:29:26.837948 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 186/384] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:26 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:26.865900 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7f893dad-e456-4dda-a5e8-1b3512cfcf6b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:26.866774 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7f893dad-e456-4dda-a5e8-1b3512cfcf6b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:26.878725 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:26.887406 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f893dad-e456-4dda-a5e8-1b3512cfcf6b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:26.887915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f893dad-e456-4dda-a5e8-1b3512cfcf6b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:26.888705 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f893dad-e456-4dda-a5e8-1b3512cfcf6b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:26.889147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f893dad-e456-4dda-a5e8-1b3512cfcf6b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:27.104809 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7f893dad-e456-4dda-a5e8-1b3512cfcf6b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:27.116007 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7f893dad-e456-4dda-a5e8-1b3512cfcf6b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:27.118141 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7f893dad-e456-4dda-a5e8-1b3512cfcf6b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:27.119778 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7f893dad-e456-4dda-a5e8-1b3512cfcf6b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.260801 Jun 27 15:29:27.131305 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 199/385] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:26 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:27.872653 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ab74c65f-5a36-4e31-b629-2637335a91ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:27.873592 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ab74c65f-5a36-4e31-b629-2637335a91ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:27.877419 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=71 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:27.881108 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab74c65f-5a36-4e31-b629-2637335a91ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:27.881555 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab74c65f-5a36-4e31-b629-2637335a91ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:27.882335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab74c65f-5a36-4e31-b629-2637335a91ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:27.882763 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab74c65f-5a36-4e31-b629-2637335a91ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:28.039103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ab74c65f-5a36-4e31-b629-2637335a91ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:28.046716 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ab74c65f-5a36-4e31-b629-2637335a91ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.177955 Jun 27 15:29:28.047301 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 187/386] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:27 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:28.138812 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-205da338-c1da-4d3c-b8c1-cad411906678 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:28.140254 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-205da338-c1da-4d3c-b8c1-cad411906678 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:28.160429 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-205da338-c1da-4d3c-b8c1-cad411906678 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:28.161294 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-205da338-c1da-4d3c-b8c1-cad411906678 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:28.162088 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-205da338-c1da-4d3c-b8c1-cad411906678 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:28.162524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-205da338-c1da-4d3c-b8c1-cad411906678 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:28.333312 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-205da338-c1da-4d3c-b8c1-cad411906678 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:28.342821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-205da338-c1da-4d3c-b8c1-cad411906678 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:28.344385 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-205da338-c1da-4d3c-b8c1-cad411906678 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:28.345895 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-205da338-c1da-4d3c-b8c1-cad411906678 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.211067 Jun 27 15:29:28.357113 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 200/387] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:28 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:29.015606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-eac84428-0054-471c-a00b-1109542d45d2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:29.016634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-eac84428-0054-471c-a00b-1109542d45d2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:29.025293 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eac84428-0054-471c-a00b-1109542d45d2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:29.029115 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eac84428-0054-471c-a00b-1109542d45d2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:29.030230 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eac84428-0054-471c-a00b-1109542d45d2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:29.030896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eac84428-0054-471c-a00b-1109542d45d2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:29.065653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-86a56eee-fd8d-4426-b200-593f907d45a5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:29.066488 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-86a56eee-fd8d-4426-b200-593f907d45a5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:29.082965 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-86a56eee-fd8d-4426-b200-593f907d45a5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:29.083410 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-86a56eee-fd8d-4426-b200-593f907d45a5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:29.084710 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-86a56eee-fd8d-4426-b200-593f907d45a5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:29.086325 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-86a56eee-fd8d-4426-b200-593f907d45a5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:29.119842 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-eac84428-0054-471c-a00b-1109542d45d2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/ips" status: 200 len: 149 microversion: 2.1 time: 0.108016 Jun 27 15:29:29.122150 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 188/388] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jun 27 15:29:29 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/ips => generated 149 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:29:29.368513 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9a067e7d-d631-41c8-a8b6-72c3e8a92e1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:29.369142 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9a067e7d-d631-41c8-a8b6-72c3e8a92e1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:29.383171 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9a067e7d-d631-41c8-a8b6-72c3e8a92e1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:29.384230 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9a067e7d-d631-41c8-a8b6-72c3e8a92e1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:29.388233 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9a067e7d-d631-41c8-a8b6-72c3e8a92e1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:29.388933 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9a067e7d-d631-41c8-a8b6-72c3e8a92e1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:29.554720 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-86a56eee-fd8d-4426-b200-593f907d45a5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:29.568286 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-86a56eee-fd8d-4426-b200-593f907d45a5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.506606 Jun 27 15:29:29.570583 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 201/389] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:29 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:29.788966 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9a067e7d-d631-41c8-a8b6-72c3e8a92e1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:29.801074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9a067e7d-d631-41c8-a8b6-72c3e8a92e1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:29.803025 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9a067e7d-d631-41c8-a8b6-72c3e8a92e1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:29.804304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9a067e7d-d631-41c8-a8b6-72c3e8a92e1e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.443937 Jun 27 15:29:29.804929 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 189/390] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:29 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:30.593780 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f470da93-dc7e-425a-8414-b2156134972d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:30.595723 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f470da93-dc7e-425a-8414-b2156134972d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:30.608718 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f470da93-dc7e-425a-8414-b2156134972d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:30.609958 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f470da93-dc7e-425a-8414-b2156134972d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:30.612230 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f470da93-dc7e-425a-8414-b2156134972d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:30.613319 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f470da93-dc7e-425a-8414-b2156134972d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:30.805708 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f470da93-dc7e-425a-8414-b2156134972d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:30.821952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f470da93-dc7e-425a-8414-b2156134972d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.237358 Jun 27 15:29:30.823531 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 202/391] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:30 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:30.831263 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-17830ded-f0db-49ca-a97f-3833c82324df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:30.833795 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-17830ded-f0db-49ca-a97f-3833c82324df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:30.847759 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-17830ded-f0db-49ca-a97f-3833c82324df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:30.847926 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-17830ded-f0db-49ca-a97f-3833c82324df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:30.849272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-17830ded-f0db-49ca-a97f-3833c82324df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:30.849973 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-17830ded-f0db-49ca-a97f-3833c82324df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:31.037535 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-57f116b9-ad17-4044-87ce-0e4b73221d21 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fdf0667-b5ba-4255-96b3-a97fcb765b67"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:31.038789 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-57f116b9-ad17-4044-87ce-0e4b73221d21 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:31.047012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-57f116b9-ad17-4044-87ce-0e4b73221d21 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:31.047475 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-57f116b9-ad17-4044-87ce-0e4b73221d21 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:31.048390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-57f116b9-ad17-4044-87ce-0e4b73221d21 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:31.048837 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-57f116b9-ad17-4044-87ce-0e4b73221d21 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:31.179483 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-17830ded-f0db-49ca-a97f-3833c82324df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:31.209953 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-17830ded-f0db-49ca-a97f-3833c82324df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:31.215491 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-17830ded-f0db-49ca-a97f-3833c82324df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:31.219717 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-17830ded-f0db-49ca-a97f-3833c82324df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.397927 Jun 27 15:29:31.244516 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 190/392] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:30 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:29:31.847505 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-73a8c4a3-fe24-48df-895d-de5960bd81c4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:31.848524 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-73a8c4a3-fe24-48df-895d-de5960bd81c4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:31.857913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73a8c4a3-fe24-48df-895d-de5960bd81c4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:31.858780 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73a8c4a3-fe24-48df-895d-de5960bd81c4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:31.860549 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73a8c4a3-fe24-48df-895d-de5960bd81c4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:31.861714 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73a8c4a3-fe24-48df-895d-de5960bd81c4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:32.314686 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-73a8c4a3-fe24-48df-895d-de5960bd81c4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:32.338156 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-73a8c4a3-fe24-48df-895d-de5960bd81c4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.494469 Jun 27 15:29:32.359280 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 191/393] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:31 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:32.370045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1ecae788-7c84-4846-9434-638cdfc6aa46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:32.371516 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-1ecae788-7c84-4846-9434-638cdfc6aa46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:32.383821 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1ecae788-7c84-4846-9434-638cdfc6aa46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:32.384912 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1ecae788-7c84-4846-9434-638cdfc6aa46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:32.386606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1ecae788-7c84-4846-9434-638cdfc6aa46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:32.387601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1ecae788-7c84-4846-9434-638cdfc6aa46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:33.034461 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1ecae788-7c84-4846-9434-638cdfc6aa46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:33.038091 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=100 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:33.058977 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1ecae788-7c84-4846-9434-638cdfc6aa46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:33.062230 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1ecae788-7c84-4846-9434-638cdfc6aa46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:33.064487 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-1ecae788-7c84-4846-9434-638cdfc6aa46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.701851 Jun 27 15:29:33.065437 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 192/394] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:32 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 705 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:33.374413 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6ad25472-ca18-4671-9442-7adcf9470f1c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:33.377835 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-6ad25472-ca18-4671-9442-7adcf9470f1c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:33.393562 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6ad25472-ca18-4671-9442-7adcf9470f1c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:33.395165 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6ad25472-ca18-4671-9442-7adcf9470f1c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:33.398521 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6ad25472-ca18-4671-9442-7adcf9470f1c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:33.400076 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6ad25472-ca18-4671-9442-7adcf9470f1c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:33.654770 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6ad25472-ca18-4671-9442-7adcf9470f1c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:33.663465 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-6ad25472-ca18-4671-9442-7adcf9470f1c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.298321 Jun 27 15:29:33.664401 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 193/395] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:33 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:34.093566 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1cd157ba-54a3-4160-83ef-78926370ea17 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:34.095866 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-1cd157ba-54a3-4160-83ef-78926370ea17 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:34.104168 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1cd157ba-54a3-4160-83ef-78926370ea17 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:34.104820 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1cd157ba-54a3-4160-83ef-78926370ea17 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:34.105882 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1cd157ba-54a3-4160-83ef-78926370ea17 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:34.106337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1cd157ba-54a3-4160-83ef-78926370ea17 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:34.316133 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1cd157ba-54a3-4160-83ef-78926370ea17 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:34.327418 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1cd157ba-54a3-4160-83ef-78926370ea17 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:34.330593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1cd157ba-54a3-4160-83ef-78926370ea17 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:34.334474 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-1cd157ba-54a3-4160-83ef-78926370ea17 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.245335 Jun 27 15:29:34.346997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 194/396] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:34 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:34.693474 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f622a8ab-30d8-4e89-a4c4-3e472bca5426 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:34.694934 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f622a8ab-30d8-4e89-a4c4-3e472bca5426 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:34.707282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f622a8ab-30d8-4e89-a4c4-3e472bca5426 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:34.709900 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f622a8ab-30d8-4e89-a4c4-3e472bca5426 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:34.711688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f622a8ab-30d8-4e89-a4c4-3e472bca5426 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:34.712750 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f622a8ab-30d8-4e89-a4c4-3e472bca5426 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:34.909938 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f622a8ab-30d8-4e89-a4c4-3e472bca5426 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:34.919102 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f622a8ab-30d8-4e89-a4c4-3e472bca5426 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.233867 Jun 27 15:29:34.919848 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 195/397] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:34 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:35.360017 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-74cbe7cb-6102-43bd-b9af-9515d65d7378 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:35.360861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-74cbe7cb-6102-43bd-b9af-9515d65d7378 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:35.368964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-74cbe7cb-6102-43bd-b9af-9515d65d7378 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:35.369726 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-74cbe7cb-6102-43bd-b9af-9515d65d7378 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:35.370730 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-74cbe7cb-6102-43bd-b9af-9515d65d7378 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:35.371963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-74cbe7cb-6102-43bd-b9af-9515d65d7378 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:35.667539 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-74cbe7cb-6102-43bd-b9af-9515d65d7378 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:35.680558 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-74cbe7cb-6102-43bd-b9af-9515d65d7378 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:35.690995 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-74cbe7cb-6102-43bd-b9af-9515d65d7378 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:35.700476 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-74cbe7cb-6102-43bd-b9af-9515d65d7378 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1749 microversion: 2.20 time: 0.340080 Jun 27 15:29:35.711429 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 196/398] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:35 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1749 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:35.939492 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9ce07dbc-3092-45d7-83ae-a4c6379bc316 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:35.940627 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9ce07dbc-3092-45d7-83ae-a4c6379bc316 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:35.947746 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9ce07dbc-3092-45d7-83ae-a4c6379bc316 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:35.948196 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9ce07dbc-3092-45d7-83ae-a4c6379bc316 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:35.949188 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9ce07dbc-3092-45d7-83ae-a4c6379bc316 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:35.949792 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9ce07dbc-3092-45d7-83ae-a4c6379bc316 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:36.344986 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9ce07dbc-3092-45d7-83ae-a4c6379bc316 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:36.370432 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9ce07dbc-3092-45d7-83ae-a4c6379bc316 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.437306 Jun 27 15:29:36.388056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 197/399] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:35 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:36.616100 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-57f116b9-ad17-4044-87ce-0e4b73221d21 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.593761 Jun 27 15:29:36.622071 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 203/400] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:29:31 2022] POST /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments => generated 194 bytes in 5601 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:29:36.719275 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4dadeb95-4022-42bf-af87-0e03dfea8d62 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:36.719974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4dadeb95-4022-42bf-af87-0e03dfea8d62 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:36.726691 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4dadeb95-4022-42bf-af87-0e03dfea8d62 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:36.727145 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4dadeb95-4022-42bf-af87-0e03dfea8d62 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:36.727924 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4dadeb95-4022-42bf-af87-0e03dfea8d62 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:36.728527 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4dadeb95-4022-42bf-af87-0e03dfea8d62 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:37.045883 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4dadeb95-4022-42bf-af87-0e03dfea8d62 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:37.055634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4dadeb95-4022-42bf-af87-0e03dfea8d62 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:37.065734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4dadeb95-4022-42bf-af87-0e03dfea8d62 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:37.067124 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4dadeb95-4022-42bf-af87-0e03dfea8d62 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1751 microversion: 2.20 time: 0.351862 Jun 27 15:29:37.070394 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 198/401] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:36 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1751 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:37.394139 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-747c44bd-3f3a-4755-921d-2780105d7811 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:37.395038 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-747c44bd-3f3a-4755-921d-2780105d7811 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:37.412165 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-747c44bd-3f3a-4755-921d-2780105d7811 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:37.413065 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-747c44bd-3f3a-4755-921d-2780105d7811 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:37.414124 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-747c44bd-3f3a-4755-921d-2780105d7811 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:37.414811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-747c44bd-3f3a-4755-921d-2780105d7811 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:37.586676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-747c44bd-3f3a-4755-921d-2780105d7811 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:37.594778 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-747c44bd-3f3a-4755-921d-2780105d7811 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.205093 Jun 27 15:29:37.595382 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 204/402] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:37 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:38.085626 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ff1221c2-8730-42d7-bb8c-0aca8c09fcbd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:38.086342 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ff1221c2-8730-42d7-bb8c-0aca8c09fcbd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:38.095907 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ff1221c2-8730-42d7-bb8c-0aca8c09fcbd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:38.096347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ff1221c2-8730-42d7-bb8c-0aca8c09fcbd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:38.097159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ff1221c2-8730-42d7-bb8c-0aca8c09fcbd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:38.097584 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ff1221c2-8730-42d7-bb8c-0aca8c09fcbd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:38.242360 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ff1221c2-8730-42d7-bb8c-0aca8c09fcbd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:38.251340 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ff1221c2-8730-42d7-bb8c-0aca8c09fcbd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:38.252857 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ff1221c2-8730-42d7-bb8c-0aca8c09fcbd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:38.254015 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ff1221c2-8730-42d7-bb8c-0aca8c09fcbd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1751 microversion: 2.20 time: 0.172361 Jun 27 15:29:38.254554 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 199/403] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:38 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:38.612799 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-58fc0181-f596-4825-a027-219b04bc0389 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:38.613370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-58fc0181-f596-4825-a027-219b04bc0389 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:38.620366 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58fc0181-f596-4825-a027-219b04bc0389 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:38.620818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58fc0181-f596-4825-a027-219b04bc0389 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:38.621584 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58fc0181-f596-4825-a027-219b04bc0389 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:38.622022 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-58fc0181-f596-4825-a027-219b04bc0389 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:38.774386 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-58fc0181-f596-4825-a027-219b04bc0389 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:38.780927 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-58fc0181-f596-4825-a027-219b04bc0389 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.172358 Jun 27 15:29:38.781544 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 205/404] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:38 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:39.275209 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e1dbd04b-968e-4637-a627-deae77599414 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:39.275943 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e1dbd04b-968e-4637-a627-deae77599414 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:39.287375 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e1dbd04b-968e-4637-a627-deae77599414 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:39.287886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e1dbd04b-968e-4637-a627-deae77599414 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:39.288729 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e1dbd04b-968e-4637-a627-deae77599414 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:39.289168 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e1dbd04b-968e-4637-a627-deae77599414 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:39.437861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e1dbd04b-968e-4637-a627-deae77599414 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:39.447282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e1dbd04b-968e-4637-a627-deae77599414 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:39.448914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e1dbd04b-968e-4637-a627-deae77599414 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:39.450142 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e1dbd04b-968e-4637-a627-deae77599414 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1751 microversion: 2.20 time: 0.178970 Jun 27 15:29:39.451713 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 200/405] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:39 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1751 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:39.800309 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-63c7b690-2263-4ee3-819b-371ae907964b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:39.800916 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-63c7b690-2263-4ee3-819b-371ae907964b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:39.807935 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63c7b690-2263-4ee3-819b-371ae907964b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:39.808417 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63c7b690-2263-4ee3-819b-371ae907964b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:39.809545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63c7b690-2263-4ee3-819b-371ae907964b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:39.809980 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63c7b690-2263-4ee3-819b-371ae907964b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:39.949706 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-63c7b690-2263-4ee3-819b-371ae907964b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:39.964955 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-63c7b690-2263-4ee3-819b-371ae907964b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.169372 Jun 27 15:29:39.965747 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 206/406] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:39 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:40.472303 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e4dccb67-ab7b-4fc4-8cb0-491382bb9e65 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:40.472913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e4dccb67-ab7b-4fc4-8cb0-491382bb9e65 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:40.479627 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4dccb67-ab7b-4fc4-8cb0-491382bb9e65 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:40.480092 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4dccb67-ab7b-4fc4-8cb0-491382bb9e65 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:40.480858 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4dccb67-ab7b-4fc4-8cb0-491382bb9e65 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:40.481298 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4dccb67-ab7b-4fc4-8cb0-491382bb9e65 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:40.627761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e4dccb67-ab7b-4fc4-8cb0-491382bb9e65 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:40.637412 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e4dccb67-ab7b-4fc4-8cb0-491382bb9e65 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:40.638927 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e4dccb67-ab7b-4fc4-8cb0-491382bb9e65 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:40.640135 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e4dccb67-ab7b-4fc4-8cb0-491382bb9e65 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1751 microversion: 2.20 time: 0.174869 Jun 27 15:29:40.640734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 201/407] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:40 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1751 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:40.982058 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dbf98a1c-9360-48e8-818e-fde411968347 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:40.982697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dbf98a1c-9360-48e8-818e-fde411968347 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:40.990070 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbf98a1c-9360-48e8-818e-fde411968347 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:40.990513 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbf98a1c-9360-48e8-818e-fde411968347 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:40.991344 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbf98a1c-9360-48e8-818e-fde411968347 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:40.991790 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbf98a1c-9360-48e8-818e-fde411968347 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:41.007788 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:41.140653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dbf98a1c-9360-48e8-818e-fde411968347 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:41.149005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dbf98a1c-9360-48e8-818e-fde411968347 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.171031 Jun 27 15:29:41.149592 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 207/408] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:40 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:41.576444 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-800655016", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "networks": [{"uuid": "05882426-bf21-41a8-ab57-641909717128"}]}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:41.630480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] validate_networks() for [('05882426-bf21-41a8-ab57-641909717128', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:29:41.660228 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a2970e93-d78c-4feb-b75e-096953030671 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:41.661230 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a2970e93-d78c-4feb-b75e-096953030671 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:41.667957 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2970e93-d78c-4feb-b75e-096953030671 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:41.668933 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2970e93-d78c-4feb-b75e-096953030671 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:41.669709 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2970e93-d78c-4feb-b75e-096953030671 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:41.670363 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a2970e93-d78c-4feb-b75e-096953030671 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:41.940581 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a2970e93-d78c-4feb-b75e-096953030671 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:41.956555 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a2970e93-d78c-4feb-b75e-096953030671 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:41.958967 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a2970e93-d78c-4feb-b75e-096953030671 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:41.960580 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a2970e93-d78c-4feb-b75e-096953030671 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1751 microversion: 2.20 time: 0.305026 Jun 27 15:29:41.963398 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 208/409] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:41 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1751 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:29:42.170454 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-74627121-0790-479a-939c-095b679713ac tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:42.171563 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-74627121-0790-479a-939c-095b679713ac tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:42.178785 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-74627121-0790-479a-939c-095b679713ac tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:42.179668 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-74627121-0790-479a-939c-095b679713ac tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:42.180673 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-74627121-0790-479a-939c-095b679713ac tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:42.181407 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-74627121-0790-479a-939c-095b679713ac tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:42.191253 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:29:42.191997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:29:42.192879 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:29:42.193553 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:29:42.194430 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:29:42.214451 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:42.215392 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:42.216662 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:42.223830 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:42.279122 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Getting quotas for project fe9612aa8fdd4be0a4a3ecfaefb96fca. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:29:42.285426 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Getting quotas for user 4e1f142fbc2a4159b5ad3a672170db10 and project fe9612aa8fdd4be0a4a3ecfaefb96fca. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:29:42.303255 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:29:42.307135 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:29:42.363046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8f7ee19d-14f3-4360-a457-236c43b79756 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.790550 Jun 27 15:29:42.364029 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 202/410] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:29:41 2022] POST /compute/v2.1/servers => generated 380 bytes in 792 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:29:42.380705 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b209e331-73ea-43cd-9be2-1ceac7da568f tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:42.381330 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b209e331-73ea-43cd-9be2-1ceac7da568f tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:42.388706 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-74627121-0790-479a-939c-095b679713ac tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:42.406323 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-74627121-0790-479a-939c-095b679713ac tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.239732 Jun 27 15:29:42.407077 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 209/411] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:42 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:42.535312 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b209e331-73ea-43cd-9be2-1ceac7da568f tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:42.545896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b209e331-73ea-43cd-9be2-1ceac7da568f tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1218 microversion: 2.1 time: 0.172560 Jun 27 15:29:42.552655 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 203/412] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:42 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1218 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:42.992686 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2ea9db3e-f98f-4861-9345-914d211ec4c1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:42.993428 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2ea9db3e-f98f-4861-9345-914d211ec4c1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:43.000262 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ea9db3e-f98f-4861-9345-914d211ec4c1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:43.000877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ea9db3e-f98f-4861-9345-914d211ec4c1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:43.001652 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ea9db3e-f98f-4861-9345-914d211ec4c1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:43.002076 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ea9db3e-f98f-4861-9345-914d211ec4c1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:43.223622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2ea9db3e-f98f-4861-9345-914d211ec4c1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:43.235630 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2ea9db3e-f98f-4861-9345-914d211ec4c1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:43.238166 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2ea9db3e-f98f-4861-9345-914d211ec4c1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:43.239524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2ea9db3e-f98f-4861-9345-914d211ec4c1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.252185 Jun 27 15:29:43.240287 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 210/413] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:42 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:29:43.426894 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-190120f7-5e6d-4763-a3b0-3541dc1f439c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:43.428860 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-190120f7-5e6d-4763-a3b0-3541dc1f439c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:43.436951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-190120f7-5e6d-4763-a3b0-3541dc1f439c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:43.437408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-190120f7-5e6d-4763-a3b0-3541dc1f439c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:43.439258 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-190120f7-5e6d-4763-a3b0-3541dc1f439c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:43.443146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-190120f7-5e6d-4763-a3b0-3541dc1f439c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:43.572308 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7b18fb37-f70b-4a91-806f-2b29e7c9045e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:43.572308 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7b18fb37-f70b-4a91-806f-2b29e7c9045e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:43.578848 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b18fb37-f70b-4a91-806f-2b29e7c9045e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:43.579306 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b18fb37-f70b-4a91-806f-2b29e7c9045e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:43.580092 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b18fb37-f70b-4a91-806f-2b29e7c9045e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:43.580705 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7b18fb37-f70b-4a91-806f-2b29e7c9045e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:43.631774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-190120f7-5e6d-4763-a3b0-3541dc1f439c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:43.643720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-190120f7-5e6d-4763-a3b0-3541dc1f439c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.222891 Jun 27 15:29:43.644761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 204/414] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:43 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:43.661720 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7b18fb37-f70b-4a91-806f-2b29e7c9045e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:43.669627 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7b18fb37-f70b-4a91-806f-2b29e7c9045e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1270 microversion: 2.1 time: 0.102105 Jun 27 15:29:43.670220 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 211/415] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:43 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1270 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:44.095737 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-17cdb8a6-b3c7-446a-8593-d48fb8a94ab1 req-4269cebb-3649-47d6-98b0-4702b00104f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5aa595-85d6-44d8-9b6a-0fd0e958657c", "name": "network-vif-plugged", "status": "completed", "tag": "3ccbca6d-373a-42a6-9d88-221bb0b77dd5"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:44.115827 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-17cdb8a6-b3c7-446a-8593-d48fb8a94ab1 req-4269cebb-3649-47d6-98b0-4702b00104f2 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:44.116265 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-17cdb8a6-b3c7-446a-8593-d48fb8a94ab1 req-4269cebb-3649-47d6-98b0-4702b00104f2 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:44.137132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-17cdb8a6-b3c7-446a-8593-d48fb8a94ab1 req-4269cebb-3649-47d6-98b0-4702b00104f2 service nova] Creating event network-vif-plugged:3ccbca6d-373a-42a6-9d88-221bb0b77dd5 for instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c on hv-cinder-84779 Jun 27 15:29:44.143230 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-17cdb8a6-b3c7-446a-8593-d48fb8a94ab1 req-4269cebb-3649-47d6-98b0-4702b00104f2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055053 Jun 27 15:29:44.144203 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 205/416] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:29:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:29:44.266455 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-af988416-ff6f-44be-b82a-31c29b582fc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:44.266889 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-af988416-ff6f-44be-b82a-31c29b582fc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:44.277679 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af988416-ff6f-44be-b82a-31c29b582fc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:44.278290 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af988416-ff6f-44be-b82a-31c29b582fc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:44.279268 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af988416-ff6f-44be-b82a-31c29b582fc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:44.279788 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af988416-ff6f-44be-b82a-31c29b582fc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:44.568730 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-af988416-ff6f-44be-b82a-31c29b582fc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:44.579179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-af988416-ff6f-44be-b82a-31c29b582fc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:44.581491 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-af988416-ff6f-44be-b82a-31c29b582fc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:44.582846 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-af988416-ff6f-44be-b82a-31c29b582fc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.320762 Jun 27 15:29:44.594960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 212/417] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:44 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:44.663633 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3f5a079d-950e-49da-8a4b-e8f77940fa3c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:44.664353 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3f5a079d-950e-49da-8a4b-e8f77940fa3c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:44.674672 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f5a079d-950e-49da-8a4b-e8f77940fa3c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:44.676558 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f5a079d-950e-49da-8a4b-e8f77940fa3c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:44.677484 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f5a079d-950e-49da-8a4b-e8f77940fa3c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:44.677845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f5a079d-950e-49da-8a4b-e8f77940fa3c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:44.698417 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-34c461ed-eb4b-42f1-b0b7-f5ae83e0903b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:44.700128 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-34c461ed-eb4b-42f1-b0b7-f5ae83e0903b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:44.716670 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34c461ed-eb4b-42f1-b0b7-f5ae83e0903b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:44.717147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34c461ed-eb4b-42f1-b0b7-f5ae83e0903b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:44.717951 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34c461ed-eb4b-42f1-b0b7-f5ae83e0903b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:44.718382 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-34c461ed-eb4b-42f1-b0b7-f5ae83e0903b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:44.789218 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-34c461ed-eb4b-42f1-b0b7-f5ae83e0903b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:44.796994 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-34c461ed-eb4b-42f1-b0b7-f5ae83e0903b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1276 microversion: 2.1 time: 0.110606 Jun 27 15:29:44.797583 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 213/418] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:44 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:44.873496 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3f5a079d-950e-49da-8a4b-e8f77940fa3c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:44.881879 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3f5a079d-950e-49da-8a4b-e8f77940fa3c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.223011 Jun 27 15:29:44.882853 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 206/419] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:44 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:45.601976 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-af4d337a-5a55-492a-ae79-1356d729fb82 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:45.602567 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-af4d337a-5a55-492a-ae79-1356d729fb82 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:45.609524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af4d337a-5a55-492a-ae79-1356d729fb82 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:45.609970 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af4d337a-5a55-492a-ae79-1356d729fb82 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:45.610754 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af4d337a-5a55-492a-ae79-1356d729fb82 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:45.611226 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af4d337a-5a55-492a-ae79-1356d729fb82 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:45.797356 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-af4d337a-5a55-492a-ae79-1356d729fb82 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:45.811102 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-af4d337a-5a55-492a-ae79-1356d729fb82 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:45.815937 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-af4d337a-5a55-492a-ae79-1356d729fb82 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:45.817634 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-af4d337a-5a55-492a-ae79-1356d729fb82 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.219841 Jun 27 15:29:45.818755 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 214/420] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:45 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:45.821497 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-bde004bc-6e1b-4e86-a7b0-4d8b159c4d1e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:45.822753 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-bde004bc-6e1b-4e86-a7b0-4d8b159c4d1e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:45.870265 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bde004bc-6e1b-4e86-a7b0-4d8b159c4d1e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:45.870784 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bde004bc-6e1b-4e86-a7b0-4d8b159c4d1e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:45.871982 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bde004bc-6e1b-4e86-a7b0-4d8b159c4d1e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:45.872749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bde004bc-6e1b-4e86-a7b0-4d8b159c4d1e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:45.899520 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b3388143-a624-497e-89f4-e7545d721154 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:45.900499 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b3388143-a624-497e-89f4-e7545d721154 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:45.907400 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3388143-a624-497e-89f4-e7545d721154 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:45.908003 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3388143-a624-497e-89f4-e7545d721154 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:45.909260 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3388143-a624-497e-89f4-e7545d721154 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:45.910482 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3388143-a624-497e-89f4-e7545d721154 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:46.173880 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-bde004bc-6e1b-4e86-a7b0-4d8b159c4d1e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:46.184651 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-bde004bc-6e1b-4e86-a7b0-4d8b159c4d1e tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.373101 Jun 27 15:29:46.187470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 207/421] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:45 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:46.208456 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b3388143-a624-497e-89f4-e7545d721154 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:46.216733 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b3388143-a624-497e-89f4-e7545d721154 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.321092 Jun 27 15:29:46.217919 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 215/422] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:45 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:46.839910 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6bd09670-49cc-4aa5-8652-52971bea9e9d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:46.840541 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-6bd09670-49cc-4aa5-8652-52971bea9e9d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:46.846938 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6bd09670-49cc-4aa5-8652-52971bea9e9d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:46.847380 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6bd09670-49cc-4aa5-8652-52971bea9e9d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:46.848122 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6bd09670-49cc-4aa5-8652-52971bea9e9d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:46.848790 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6bd09670-49cc-4aa5-8652-52971bea9e9d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:47.011649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6bd09670-49cc-4aa5-8652-52971bea9e9d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:47.027968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6bd09670-49cc-4aa5-8652-52971bea9e9d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:47.029671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6bd09670-49cc-4aa5-8652-52971bea9e9d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:47.031880 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-6bd09670-49cc-4aa5-8652-52971bea9e9d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.195800 Jun 27 15:29:47.032933 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 208/423] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:46 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:47.208187 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-239a074d-6184-4187-b08a-bd3f50d370b4 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:47.209504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-239a074d-6184-4187-b08a-bd3f50d370b4 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:47.217879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-239a074d-6184-4187-b08a-bd3f50d370b4 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:47.218740 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-239a074d-6184-4187-b08a-bd3f50d370b4 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:47.224564 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-239a074d-6184-4187-b08a-bd3f50d370b4 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:47.224564 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-239a074d-6184-4187-b08a-bd3f50d370b4 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:47.244862 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3b3e29f6-ad99-4e91-9e8b-da76861ee568 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:47.247270 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3b3e29f6-ad99-4e91-9e8b-da76861ee568 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:47.262659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b3e29f6-ad99-4e91-9e8b-da76861ee568 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:47.263791 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b3e29f6-ad99-4e91-9e8b-da76861ee568 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:47.266797 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b3e29f6-ad99-4e91-9e8b-da76861ee568 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:47.267344 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b3e29f6-ad99-4e91-9e8b-da76861ee568 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:47.466412 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-239a074d-6184-4187-b08a-bd3f50d370b4 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:47.488996 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-239a074d-6184-4187-b08a-bd3f50d370b4 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.287422 Jun 27 15:29:47.503643 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 216/424] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:47 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:47.504047 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3b3e29f6-ad99-4e91-9e8b-da76861ee568 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:47.513231 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3b3e29f6-ad99-4e91-9e8b-da76861ee568 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.276720 Jun 27 15:29:47.515921 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 209/425] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:47 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:48.063343 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4b2a130e-55e1-4311-9e3f-fcc27f86e5df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:48.064193 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4b2a130e-55e1-4311-9e3f-fcc27f86e5df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:48.072973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b2a130e-55e1-4311-9e3f-fcc27f86e5df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:48.073524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b2a130e-55e1-4311-9e3f-fcc27f86e5df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:48.074549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b2a130e-55e1-4311-9e3f-fcc27f86e5df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:48.075001 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4b2a130e-55e1-4311-9e3f-fcc27f86e5df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:48.325861 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4b2a130e-55e1-4311-9e3f-fcc27f86e5df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:48.335479 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4b2a130e-55e1-4311-9e3f-fcc27f86e5df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:48.337105 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4b2a130e-55e1-4311-9e3f-fcc27f86e5df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:48.338236 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4b2a130e-55e1-4311-9e3f-fcc27f86e5df tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.280766 Jun 27 15:29:48.338778 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 217/426] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:48 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:48.512233 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f09a9c35-2760-47b0-8dfa-4def418ef733 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:48.513207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f09a9c35-2760-47b0-8dfa-4def418ef733 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:48.520661 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f09a9c35-2760-47b0-8dfa-4def418ef733 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:48.521202 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f09a9c35-2760-47b0-8dfa-4def418ef733 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:48.522043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f09a9c35-2760-47b0-8dfa-4def418ef733 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:48.522478 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f09a9c35-2760-47b0-8dfa-4def418ef733 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:48.530712 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-631ebcb3-79a2-46ef-9411-4e6f4946e094 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:48.531313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-631ebcb3-79a2-46ef-9411-4e6f4946e094 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:48.537991 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-631ebcb3-79a2-46ef-9411-4e6f4946e094 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:48.538450 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-631ebcb3-79a2-46ef-9411-4e6f4946e094 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:48.539221 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-631ebcb3-79a2-46ef-9411-4e6f4946e094 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:48.539650 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-631ebcb3-79a2-46ef-9411-4e6f4946e094 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:48.710631 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f09a9c35-2760-47b0-8dfa-4def418ef733 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:48.724012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f09a9c35-2760-47b0-8dfa-4def418ef733 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.217939 Jun 27 15:29:48.725014 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 210/427] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:48 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:48.742723 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-631ebcb3-79a2-46ef-9411-4e6f4946e094 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:48.753608 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-631ebcb3-79a2-46ef-9411-4e6f4946e094 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.226583 Jun 27 15:29:48.755121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 218/428] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:48 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:49.358232 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c632f0de-f831-482b-b649-b13ed0011eb3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:49.358853 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-c632f0de-f831-482b-b649-b13ed0011eb3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:49.371761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c632f0de-f831-482b-b649-b13ed0011eb3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:49.372453 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c632f0de-f831-482b-b649-b13ed0011eb3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:49.373913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c632f0de-f831-482b-b649-b13ed0011eb3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:49.374758 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c632f0de-f831-482b-b649-b13ed0011eb3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:49.578366 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-c632f0de-f831-482b-b649-b13ed0011eb3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:49.581569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=100 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:49.591165 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-c632f0de-f831-482b-b649-b13ed0011eb3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:49.593148 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-c632f0de-f831-482b-b649-b13ed0011eb3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:49.594676 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c632f0de-f831-482b-b649-b13ed0011eb3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.241058 Jun 27 15:29:49.596080 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 211/429] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:49 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:49.754801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-906d64e8-d869-43e9-b0cc-e627730f46c1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:49.755437 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-906d64e8-d869-43e9-b0cc-e627730f46c1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:49.762325 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-906d64e8-d869-43e9-b0cc-e627730f46c1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:49.762769 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-906d64e8-d869-43e9-b0cc-e627730f46c1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:49.763547 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-906d64e8-d869-43e9-b0cc-e627730f46c1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:49.763980 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-906d64e8-d869-43e9-b0cc-e627730f46c1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:49.778441 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f1f512e9-0112-4057-98b4-006b3633e503 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:49.779785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f1f512e9-0112-4057-98b4-006b3633e503 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:49.792794 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f1f512e9-0112-4057-98b4-006b3633e503 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:49.793570 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f1f512e9-0112-4057-98b4-006b3633e503 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:49.795198 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f1f512e9-0112-4057-98b4-006b3633e503 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:49.796245 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f1f512e9-0112-4057-98b4-006b3633e503 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:49.950243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-906d64e8-d869-43e9-b0cc-e627730f46c1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:49.959226 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-906d64e8-d869-43e9-b0cc-e627730f46c1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.209327 Jun 27 15:29:49.973464 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f1f512e9-0112-4057-98b4-006b3633e503 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:49.980552 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 219/430] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:49 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:49.983797 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f1f512e9-0112-4057-98b4-006b3633e503 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.212461 Jun 27 15:29:49.984964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 212/431] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:49 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:50.616582 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f9002fa3-92f3-442c-be84-11387236c52f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:50.617643 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f9002fa3-92f3-442c-be84-11387236c52f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:50.627180 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9002fa3-92f3-442c-be84-11387236c52f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:50.628312 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9002fa3-92f3-442c-be84-11387236c52f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:50.629765 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9002fa3-92f3-442c-be84-11387236c52f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:50.630519 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f9002fa3-92f3-442c-be84-11387236c52f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:50.850899 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f9002fa3-92f3-442c-be84-11387236c52f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:50.869755 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f9002fa3-92f3-442c-be84-11387236c52f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:50.872624 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f9002fa3-92f3-442c-be84-11387236c52f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:50.875081 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f9002fa3-92f3-442c-be84-11387236c52f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.264156 Jun 27 15:29:50.876399 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 220/432] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:50 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:50.981756 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1efe5c6c-5f66-4d6a-bb7d-da09ba2a4659 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:50.984028 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-1efe5c6c-5f66-4d6a-bb7d-da09ba2a4659 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:50.997739 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1efe5c6c-5f66-4d6a-bb7d-da09ba2a4659 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:50.998888 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1efe5c6c-5f66-4d6a-bb7d-da09ba2a4659 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:51.000631 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1efe5c6c-5f66-4d6a-bb7d-da09ba2a4659 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:51.001619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1efe5c6c-5f66-4d6a-bb7d-da09ba2a4659 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:51.006289 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1115b015-41cc-4c6b-8c84-a6a7801632bd tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:51.007089 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1115b015-41cc-4c6b-8c84-a6a7801632bd tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:51.014707 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1115b015-41cc-4c6b-8c84-a6a7801632bd tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:51.015216 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1115b015-41cc-4c6b-8c84-a6a7801632bd tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:51.016364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1115b015-41cc-4c6b-8c84-a6a7801632bd tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:51.016855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1115b015-41cc-4c6b-8c84-a6a7801632bd tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:51.240263 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1efe5c6c-5f66-4d6a-bb7d-da09ba2a4659 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:51.250542 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-1efe5c6c-5f66-4d6a-bb7d-da09ba2a4659 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.275991 Jun 27 15:29:51.255030 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 213/433] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:50 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:51.277450 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1115b015-41cc-4c6b-8c84-a6a7801632bd tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:51.286639 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1115b015-41cc-4c6b-8c84-a6a7801632bd tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.287430 Jun 27 15:29:51.287613 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 221/434] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:50 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:51.900459 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a7c89af1-e69b-4f39-aac6-68f898cf479e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:51.901110 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a7c89af1-e69b-4f39-aac6-68f898cf479e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:51.907653 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a7c89af1-e69b-4f39-aac6-68f898cf479e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:51.908090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a7c89af1-e69b-4f39-aac6-68f898cf479e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:51.909799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a7c89af1-e69b-4f39-aac6-68f898cf479e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:51.910238 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a7c89af1-e69b-4f39-aac6-68f898cf479e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:52.062786 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a7c89af1-e69b-4f39-aac6-68f898cf479e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:52.073211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a7c89af1-e69b-4f39-aac6-68f898cf479e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:52.074951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a7c89af1-e69b-4f39-aac6-68f898cf479e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:52.076232 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a7c89af1-e69b-4f39-aac6-68f898cf479e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.179873 Jun 27 15:29:52.076840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 214/435] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:51 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:52.275893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6d98c17e-0fdc-4f56-b34e-3ea57e7c11a8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:52.278522 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6d98c17e-0fdc-4f56-b34e-3ea57e7c11a8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:52.286572 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d98c17e-0fdc-4f56-b34e-3ea57e7c11a8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:52.287059 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d98c17e-0fdc-4f56-b34e-3ea57e7c11a8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:52.287898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d98c17e-0fdc-4f56-b34e-3ea57e7c11a8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:52.288309 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d98c17e-0fdc-4f56-b34e-3ea57e7c11a8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:52.317247 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b84e6c64-2d8a-4333-9909-024ba7b00350 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:52.318084 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b84e6c64-2d8a-4333-9909-024ba7b00350 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:52.324725 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:52.329551 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b84e6c64-2d8a-4333-9909-024ba7b00350 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:52.329966 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b84e6c64-2d8a-4333-9909-024ba7b00350 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:52.331214 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b84e6c64-2d8a-4333-9909-024ba7b00350 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:52.331628 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b84e6c64-2d8a-4333-9909-024ba7b00350 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:52.444717 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6d98c17e-0fdc-4f56-b34e-3ea57e7c11a8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:52.453922 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6d98c17e-0fdc-4f56-b34e-3ea57e7c11a8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.182456 Jun 27 15:29:52.455135 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 222/436] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:52 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:52.486788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b84e6c64-2d8a-4333-9909-024ba7b00350 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:52.494621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b84e6c64-2d8a-4333-9909-024ba7b00350 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.181785 Jun 27 15:29:52.495198 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 215/437] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:52 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:53.096000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c67d44b2-0702-40c3-800a-7432fd04a6d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:53.096772 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c67d44b2-0702-40c3-800a-7432fd04a6d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:53.103455 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c67d44b2-0702-40c3-800a-7432fd04a6d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:53.104183 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c67d44b2-0702-40c3-800a-7432fd04a6d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:53.105166 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c67d44b2-0702-40c3-800a-7432fd04a6d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:53.105813 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c67d44b2-0702-40c3-800a-7432fd04a6d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:53.315591 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c67d44b2-0702-40c3-800a-7432fd04a6d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:53.343636 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c67d44b2-0702-40c3-800a-7432fd04a6d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:53.346361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c67d44b2-0702-40c3-800a-7432fd04a6d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:53.347814 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c67d44b2-0702-40c3-800a-7432fd04a6d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.255900 Jun 27 15:29:53.349985 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 223/438] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:53 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:53.472514 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e063cc09-440b-4fca-8792-fff9bb26d4cd tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:53.473250 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e063cc09-440b-4fca-8792-fff9bb26d4cd tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:53.475463 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=8 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:53.484112 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e063cc09-440b-4fca-8792-fff9bb26d4cd tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:53.484969 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e063cc09-440b-4fca-8792-fff9bb26d4cd tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:53.485930 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e063cc09-440b-4fca-8792-fff9bb26d4cd tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:53.486664 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e063cc09-440b-4fca-8792-fff9bb26d4cd tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:53.518976 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6ab63e8b-8c8f-4f9a-b8eb-5e006a095ab1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:53.519832 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6ab63e8b-8c8f-4f9a-b8eb-5e006a095ab1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:53.536694 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6ab63e8b-8c8f-4f9a-b8eb-5e006a095ab1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:53.537514 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6ab63e8b-8c8f-4f9a-b8eb-5e006a095ab1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:53.539057 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6ab63e8b-8c8f-4f9a-b8eb-5e006a095ab1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:53.539769 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6ab63e8b-8c8f-4f9a-b8eb-5e006a095ab1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:53.564751 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:53.693950 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e063cc09-440b-4fca-8792-fff9bb26d4cd tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:53.715764 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e063cc09-440b-4fca-8792-fff9bb26d4cd tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.248307 Jun 27 15:29:53.716412 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 216/439] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:53 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:53.805855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6ab63e8b-8c8f-4f9a-b8eb-5e006a095ab1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:53.827129 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6ab63e8b-8c8f-4f9a-b8eb-5e006a095ab1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.316752 Jun 27 15:29:53.828788 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 224/440] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:53 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:54.368209 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f5906f4c-c12e-4f49-a0fd-a0ea88b3c86d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:54.372606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f5906f4c-c12e-4f49-a0fd-a0ea88b3c86d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:54.379448 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f5906f4c-c12e-4f49-a0fd-a0ea88b3c86d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:54.379906 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f5906f4c-c12e-4f49-a0fd-a0ea88b3c86d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:54.380739 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f5906f4c-c12e-4f49-a0fd-a0ea88b3c86d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:54.381185 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f5906f4c-c12e-4f49-a0fd-a0ea88b3c86d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:54.551952 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f5906f4c-c12e-4f49-a0fd-a0ea88b3c86d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:54.563392 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f5906f4c-c12e-4f49-a0fd-a0ea88b3c86d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:54.565423 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f5906f4c-c12e-4f49-a0fd-a0ea88b3c86d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:54.566820 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f5906f4c-c12e-4f49-a0fd-a0ea88b3c86d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.203109 Jun 27 15:29:54.567598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 217/441] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:54 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:54.737435 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-157eb8e7-8e1d-43ae-a295-59f01f9e7abe tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:54.738048 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-157eb8e7-8e1d-43ae-a295-59f01f9e7abe tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:54.745885 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-157eb8e7-8e1d-43ae-a295-59f01f9e7abe tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:54.746337 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-157eb8e7-8e1d-43ae-a295-59f01f9e7abe tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:54.747113 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-157eb8e7-8e1d-43ae-a295-59f01f9e7abe tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:54.747551 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-157eb8e7-8e1d-43ae-a295-59f01f9e7abe tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:54.850004 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-55efe5b2-a2db-46f3-8bb3-85c8e8e73e0d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:54.850880 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-55efe5b2-a2db-46f3-8bb3-85c8e8e73e0d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:54.859823 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-55efe5b2-a2db-46f3-8bb3-85c8e8e73e0d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:54.860611 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-55efe5b2-a2db-46f3-8bb3-85c8e8e73e0d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:54.861767 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-55efe5b2-a2db-46f3-8bb3-85c8e8e73e0d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:54.862368 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-55efe5b2-a2db-46f3-8bb3-85c8e8e73e0d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:54.951998 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-157eb8e7-8e1d-43ae-a295-59f01f9e7abe tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:54.962284 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-157eb8e7-8e1d-43ae-a295-59f01f9e7abe tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.229410 Jun 27 15:29:54.963349 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 225/442] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:54 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:55.066613 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-55efe5b2-a2db-46f3-8bb3-85c8e8e73e0d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:55.075266 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-55efe5b2-a2db-46f3-8bb3-85c8e8e73e0d tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.229246 Jun 27 15:29:55.076061 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 218/443] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:54 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:55.587546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8580fc63-3b65-4389-9ce9-a05229df86d9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:55.588555 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8580fc63-3b65-4389-9ce9-a05229df86d9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:55.595740 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8580fc63-3b65-4389-9ce9-a05229df86d9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:55.596285 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8580fc63-3b65-4389-9ce9-a05229df86d9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:55.597189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8580fc63-3b65-4389-9ce9-a05229df86d9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:55.597641 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8580fc63-3b65-4389-9ce9-a05229df86d9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:55.754774 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8580fc63-3b65-4389-9ce9-a05229df86d9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:55.764125 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8580fc63-3b65-4389-9ce9-a05229df86d9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:55.765721 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8580fc63-3b65-4389-9ce9-a05229df86d9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:55.767020 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8580fc63-3b65-4389-9ce9-a05229df86d9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.184147 Jun 27 15:29:55.767559 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 226/444] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:55 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:55.950974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-41f1d6c4-d018-4102-88d1-a8047c73b636 req-128f0a1d-e842-471f-857f-6a88b24fa498 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e2cf58f-7730-4d52-8712-24fcfbf19801", "tag": "684b638a-b884-40ba-bebd-043ddafe9556"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:55.965295 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-41f1d6c4-d018-4102-88d1-a8047c73b636 req-128f0a1d-e842-471f-857f-6a88b24fa498 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:55.965710 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-41f1d6c4-d018-4102-88d1-a8047c73b636 req-128f0a1d-e842-471f-857f-6a88b24fa498 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:55.978810 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-41f1d6c4-d018-4102-88d1-a8047c73b636 req-128f0a1d-e842-471f-857f-6a88b24fa498 service nova] Creating event network-changed:684b638a-b884-40ba-bebd-043ddafe9556 for instance 5e2cf58f-7730-4d52-8712-24fcfbf19801 on hv-cinder-84779 Jun 27 15:29:55.985755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-41f1d6c4-d018-4102-88d1-a8047c73b636 req-128f0a1d-e842-471f-857f-6a88b24fa498 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042135 Jun 27 15:29:55.986755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 219/445] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:29:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:29:55.992518 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d123edcd-cef7-4ac3-ad87-a4b02a488951 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:55.993699 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d123edcd-cef7-4ac3-ad87-a4b02a488951 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:56.004934 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d123edcd-cef7-4ac3-ad87-a4b02a488951 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:56.005735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d123edcd-cef7-4ac3-ad87-a4b02a488951 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:56.007170 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d123edcd-cef7-4ac3-ad87-a4b02a488951 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:56.007973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d123edcd-cef7-4ac3-ad87-a4b02a488951 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:56.093727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-90ef8a9b-26ef-45b2-9a4a-bee695d482ff tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:56.102182 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-90ef8a9b-26ef-45b2-9a4a-bee695d482ff tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:56.115808 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-90ef8a9b-26ef-45b2-9a4a-bee695d482ff tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:56.120063 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-90ef8a9b-26ef-45b2-9a4a-bee695d482ff tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:56.121213 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-90ef8a9b-26ef-45b2-9a4a-bee695d482ff tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:56.122119 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-90ef8a9b-26ef-45b2-9a4a-bee695d482ff tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:56.215316 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d123edcd-cef7-4ac3-ad87-a4b02a488951 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:56.224973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d123edcd-cef7-4ac3-ad87-a4b02a488951 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.240271 Jun 27 15:29:56.234856 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 227/446] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:55 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:56.346163 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-90ef8a9b-26ef-45b2-9a4a-bee695d482ff tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:56.359628 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-90ef8a9b-26ef-45b2-9a4a-bee695d482ff tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.269740 Jun 27 15:29:56.360701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 220/447] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:56 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:56.786091 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6575961b-4131-48f1-99bf-bbd31204b4cb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:56.787691 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6575961b-4131-48f1-99bf-bbd31204b4cb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:56.797100 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6575961b-4131-48f1-99bf-bbd31204b4cb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:56.797971 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6575961b-4131-48f1-99bf-bbd31204b4cb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:56.799429 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6575961b-4131-48f1-99bf-bbd31204b4cb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:56.800220 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6575961b-4131-48f1-99bf-bbd31204b4cb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:56.969327 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6575961b-4131-48f1-99bf-bbd31204b4cb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:56.979064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6575961b-4131-48f1-99bf-bbd31204b4cb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:56.980650 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6575961b-4131-48f1-99bf-bbd31204b4cb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:56.981968 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6575961b-4131-48f1-99bf-bbd31204b4cb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.200315 Jun 27 15:29:56.982966 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 228/448] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:56 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:57.242884 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7c06868c-6963-4825-bacf-01a8e84f0a57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:57.243827 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7c06868c-6963-4825-bacf-01a8e84f0a57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:57.253686 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7c06868c-6963-4825-bacf-01a8e84f0a57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:57.254890 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7c06868c-6963-4825-bacf-01a8e84f0a57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:57.256512 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7c06868c-6963-4825-bacf-01a8e84f0a57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:57.257332 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7c06868c-6963-4825-bacf-01a8e84f0a57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:57.367979 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d6d6ae52-3e0c-4daf-af7f-d5aac5a2f644 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: .version_select at 0x7fb2736a5f70>, body: {"keypair": {"name": "tempest-keypair-1961411220", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF3wsf+ws8glrjQ3mJpjms9yri1cKPAW0wShnYOTBsXdAQTqT04vnm3Rr/au/nIP9PCsrRtD6t25h93sP6dH75ibJQITEogaNQbMEH4kRNrhfFf5vkU4CeWXXEbyeA108w=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:29:57.373709 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=60 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:57.386451 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-d6d6ae52-3e0c-4daf-af7f-d5aac5a2f644 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for project dff1983b1b3047378b88d87d54aa709d. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:29:57.390952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-d6d6ae52-3e0c-4daf-af7f-d5aac5a2f644 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for user 23abc809ab644c1da0270a35ac8bab21 and project dff1983b1b3047378b88d87d54aa709d. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:29:57.424812 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d6d6ae52-3e0c-4daf-af7f-d5aac5a2f644 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.060223 Jun 27 15:29:57.425740 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 229/449] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jun 27 15:29:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:29:57.442665 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0d17bcf1-1c75-4ff5-9b95-ba28bcd13fc1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:57.443960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0d17bcf1-1c75-4ff5-9b95-ba28bcd13fc1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:57.445469 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7c06868c-6963-4825-bacf-01a8e84f0a57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:57.456750 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7c06868c-6963-4825-bacf-01a8e84f0a57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.217316 Jun 27 15:29:57.457617 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 221/450] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:57 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:57.458616 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d17bcf1-1c75-4ff5-9b95-ba28bcd13fc1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:57.459568 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d17bcf1-1c75-4ff5-9b95-ba28bcd13fc1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:57.461434 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d17bcf1-1c75-4ff5-9b95-ba28bcd13fc1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:57.462215 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0d17bcf1-1c75-4ff5-9b95-ba28bcd13fc1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:57.713567 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0d17bcf1-1c75-4ff5-9b95-ba28bcd13fc1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:57.728894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0d17bcf1-1c75-4ff5-9b95-ba28bcd13fc1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1358 microversion: 2.1 time: 0.298667 Jun 27 15:29:57.730026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 230/451] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:57 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1358 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:58.013697 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f3310ceb-c0b9-4de5-b792-6f6059ed7429 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:58.013697 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f3310ceb-c0b9-4de5-b792-6f6059ed7429 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:58.013697 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:29:58.013697 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f3310ceb-c0b9-4de5-b792-6f6059ed7429 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:58.014228 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f3310ceb-c0b9-4de5-b792-6f6059ed7429 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:58.014228 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f3310ceb-c0b9-4de5-b792-6f6059ed7429 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:58.014228 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f3310ceb-c0b9-4de5-b792-6f6059ed7429 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:58.172564 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f3310ceb-c0b9-4de5-b792-6f6059ed7429 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:58.189108 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f3310ceb-c0b9-4de5-b792-6f6059ed7429 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:58.191648 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f3310ceb-c0b9-4de5-b792-6f6059ed7429 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:58.193075 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f3310ceb-c0b9-4de5-b792-6f6059ed7429 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.195155 Jun 27 15:29:58.194397 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 222/452] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:57 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:58.478891 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c9511dd3-eeb5-4bae-bb7a-6c2ba94b182c tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:58.480245 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c9511dd3-eeb5-4bae-bb7a-6c2ba94b182c tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:58.489242 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9511dd3-eeb5-4bae-bb7a-6c2ba94b182c tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:58.490046 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9511dd3-eeb5-4bae-bb7a-6c2ba94b182c tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:58.491232 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9511dd3-eeb5-4bae-bb7a-6c2ba94b182c tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:58.491685 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9511dd3-eeb5-4bae-bb7a-6c2ba94b182c tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:58.701086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c9511dd3-eeb5-4bae-bb7a-6c2ba94b182c tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:58.711343 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c9511dd3-eeb5-4bae-bb7a-6c2ba94b182c tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.236608 Jun 27 15:29:58.711997 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 231/453] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:58 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:29:58.750976 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f66cbd0e-1cd5-4108-9a36-742894341aba tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:58.752041 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f66cbd0e-1cd5-4108-9a36-742894341aba tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:58.763273 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f66cbd0e-1cd5-4108-9a36-742894341aba tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:58.764022 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f66cbd0e-1cd5-4108-9a36-742894341aba tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:58.765462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f66cbd0e-1cd5-4108-9a36-742894341aba tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:58.766214 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f66cbd0e-1cd5-4108-9a36-742894341aba tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.065611 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f66cbd0e-1cd5-4108-9a36-742894341aba tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:59.073560 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f66cbd0e-1cd5-4108-9a36-742894341aba tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1547 microversion: 2.1 time: 0.330488 Jun 27 15:29:59.074118 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 223/454] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:58 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1547 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:59.092584 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a8214501-e128-41f6-b7e3-575c62584f27 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:59.093189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a8214501-e128-41f6-b7e3-575c62584f27 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:59.101034 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a8214501-e128-41f6-b7e3-575c62584f27 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.101511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a8214501-e128-41f6-b7e3-575c62584f27 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.102279 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a8214501-e128-41f6-b7e3-575c62584f27 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.102864 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a8214501-e128-41f6-b7e3-575c62584f27 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.218292 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b306a0eb-0620-4832-b1f0-e9de9c848ee4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:59.219100 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b306a0eb-0620-4832-b1f0-e9de9c848ee4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:59.225836 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b306a0eb-0620-4832-b1f0-e9de9c848ee4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.226648 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b306a0eb-0620-4832-b1f0-e9de9c848ee4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.227473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b306a0eb-0620-4832-b1f0-e9de9c848ee4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.227880 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b306a0eb-0620-4832-b1f0-e9de9c848ee4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.260422 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a8214501-e128-41f6-b7e3-575c62584f27 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:59.269699 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a8214501-e128-41f6-b7e3-575c62584f27 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1547 microversion: 2.1 time: 0.181589 Jun 27 15:29:59.270289 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 232/455] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:59 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1547 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:59.288854 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6d13f9bc-dfae-4b27-8f66-ad2f24882f31 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:59.292824 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6d13f9bc-dfae-4b27-8f66-ad2f24882f31 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:59.293670 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6d13f9bc-dfae-4b27-8f66-ad2f24882f31 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Searching by: {'deleted': False, 'project_id': '52c96385e67941648eee6bf532b3f141'} {{(pid=117978) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 27 15:29:59.301459 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d13f9bc-dfae-4b27-8f66-ad2f24882f31 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.301933 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d13f9bc-dfae-4b27-8f66-ad2f24882f31 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.302777 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d13f9bc-dfae-4b27-8f66-ad2f24882f31 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.303218 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6d13f9bc-dfae-4b27-8f66-ad2f24882f31 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.405303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.multi_cell_list [None req-6d13f9bc-dfae-4b27-8f66-ad2f24882f31 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117978) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 27 15:29:59.482186 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b306a0eb-0620-4832-b1f0-e9de9c848ee4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:59.493123 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b306a0eb-0620-4832-b1f0-e9de9c848ee4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:59.495713 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b306a0eb-0620-4832-b1f0-e9de9c848ee4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:59.497029 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b306a0eb-0620-4832-b1f0-e9de9c848ee4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.283360 Jun 27 15:29:59.500791 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 224/456] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:29:59 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:29:59.542465 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6d13f9bc-dfae-4b27-8f66-ad2f24882f31 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.258514 Jun 27 15:29:59.548788 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 233/457] 10.222.0.26 () {58 vars in 1124 bytes} [Mon Jun 27 15:29:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:29:59.565347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-737eea93-b25d-44de-b5c8-e3e71520455c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:59.566148 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-737eea93-b25d-44de-b5c8-e3e71520455c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:59.573199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-737eea93-b25d-44de-b5c8-e3e71520455c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.573893 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-737eea93-b25d-44de-b5c8-e3e71520455c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.575025 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-737eea93-b25d-44de-b5c8-e3e71520455c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.575461 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-737eea93-b25d-44de-b5c8-e3e71520455c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.750538 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e5a16676-a41e-4683-8690-06ba0b24efdb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:59.751693 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e5a16676-a41e-4683-8690-06ba0b24efdb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:59.758803 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5a16676-a41e-4683-8690-06ba0b24efdb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.759740 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5a16676-a41e-4683-8690-06ba0b24efdb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.760801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5a16676-a41e-4683-8690-06ba0b24efdb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.761237 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5a16676-a41e-4683-8690-06ba0b24efdb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.885426 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-737eea93-b25d-44de-b5c8-e3e71520455c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:29:59.910566 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-737eea93-b25d-44de-b5c8-e3e71520455c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1547 microversion: 2.1 time: 0.353806 Jun 27 15:29:59.911806 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 225/458] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:59 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1547 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:29:59.928184 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2d67433b-a186-4a04-8bf7-2741913130f7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:29:59.929298 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2d67433b-a186-4a04-8bf7-2741913130f7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:29:59.944545 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2d67433b-a186-4a04-8bf7-2741913130f7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.945381 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2d67433b-a186-4a04-8bf7-2741913130f7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:29:59.947858 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2d67433b-a186-4a04-8bf7-2741913130f7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:29:59.948714 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2d67433b-a186-4a04-8bf7-2741913130f7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:00.012576 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e5a16676-a41e-4683-8690-06ba0b24efdb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:00.028204 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e5a16676-a41e-4683-8690-06ba0b24efdb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.286752 Jun 27 15:30:00.034302 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 234/459] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:29:59 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:00.094702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1639882958", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f2b3a5f-8943-48e2-bb0f-3f837d61206a"}], "security_groups": [{"name": "tempest-securitygroup--1355144980"}], "key_name": "tempest-keypair-1961411220", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:00.238474 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-2d67433b-a186-4a04-8bf7-2741913130f7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lazy-loading 'services' on Instance uuid 53705ab2-462b-4198-8565-c1ad2fbf535d {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:30:00.255246 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] validate_networks() for [('9f2b3a5f-8943-48e2-bb0f-3f837d61206a', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:30:00.536693 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2d67433b-a186-4a04-8bf7-2741913130f7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/os-volume_attachments/56ab45a8-e880-47ca-a641-a199275822d2" status: 202 len: 0 microversion: 2.1 time: 0.618801 Jun 27 15:30:00.538199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 226/460] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:29:59 2022] DELETE /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/os-volume_attachments/56ab45a8-e880-47ca-a641-a199275822d2 => generated 0 bytes in 622 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:30:00.549612 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-bddda772-c45c-4053-8399-fd5a492f7c57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:00.550693 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-bddda772-c45c-4053-8399-fd5a492f7c57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:00.561541 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bddda772-c45c-4053-8399-fd5a492f7c57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:00.562359 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bddda772-c45c-4053-8399-fd5a492f7c57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:00.563443 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bddda772-c45c-4053-8399-fd5a492f7c57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:00.567952 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bddda772-c45c-4053-8399-fd5a492f7c57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:00.773760 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-bddda772-c45c-4053-8399-fd5a492f7c57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:00.791145 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-bddda772-c45c-4053-8399-fd5a492f7c57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:00.794583 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-bddda772-c45c-4053-8399-fd5a492f7c57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:00.797130 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-bddda772-c45c-4053-8399-fd5a492f7c57 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.253771 Jun 27 15:30:00.798740 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 227/461] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:30:00 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:30:00.944105 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:30:00.944968 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:30:00.945430 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:30:00.945847 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:30:00.946263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:30:00.957133 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:00.957805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:00.958652 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:00.959177 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:00.978555 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for project dff1983b1b3047378b88d87d54aa709d. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:30:00.983649 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for user 23abc809ab644c1da0270a35ac8bab21 and project dff1983b1b3047378b88d87d54aa709d. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:30:00.997916 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:30:01.000283 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:30:01.046875 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-97a94835-14f7-417a-aadd-545e20ef8296 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:01.047572 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-97a94835-14f7-417a-aadd-545e20ef8296 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:01.052271 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b8c6d035-994b-4e74-ac46-a803e128cc5a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.962071 Jun 27 15:30:01.058868 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 235/462] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:30:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 969 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:30:01.064147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-802d4c04-69de-48b1-9dac-4e1545a88c89 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:01.065362 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-802d4c04-69de-48b1-9dac-4e1545a88c89 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:01.074134 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-97a94835-14f7-417a-aadd-545e20ef8296 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:01.077211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-97a94835-14f7-417a-aadd-545e20ef8296 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:01.078199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-97a94835-14f7-417a-aadd-545e20ef8296 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:01.083309 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-97a94835-14f7-417a-aadd-545e20ef8296 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:01.103502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:01.141625 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-802d4c04-69de-48b1-9dac-4e1545a88c89 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:01.150725 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-802d4c04-69de-48b1-9dac-4e1545a88c89 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1242 microversion: 2.1 time: 0.089784 Jun 27 15:30:01.161840 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 236/463] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:01 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:01.268925 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-97a94835-14f7-417a-aadd-545e20ef8296 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:01.279555 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-97a94835-14f7-417a-aadd-545e20ef8296 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.237305 Jun 27 15:30:01.280346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 228/464] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:01 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:01.783384 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d79e8d0c-ff25-4741-b7d3-b3c69a3fe2a6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8082677c-4ae6-43d5-853b-eb18e946a2f4"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:01.784764 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d79e8d0c-ff25-4741-b7d3-b3c69a3fe2a6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:01.791345 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d79e8d0c-ff25-4741-b7d3-b3c69a3fe2a6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:01.791799 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d79e8d0c-ff25-4741-b7d3-b3c69a3fe2a6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:01.792594 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d79e8d0c-ff25-4741-b7d3-b3c69a3fe2a6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:01.793032 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d79e8d0c-ff25-4741-b7d3-b3c69a3fe2a6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:01.826774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-34473041-0a1d-48d0-b02d-31d4f6309667 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:01.827993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-34473041-0a1d-48d0-b02d-31d4f6309667 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:01.835152 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34473041-0a1d-48d0-b02d-31d4f6309667 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:01.835522 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34473041-0a1d-48d0-b02d-31d4f6309667 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:01.836467 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34473041-0a1d-48d0-b02d-31d4f6309667 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:01.836991 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34473041-0a1d-48d0-b02d-31d4f6309667 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:02.002856 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-34473041-0a1d-48d0-b02d-31d4f6309667 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:02.013075 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-34473041-0a1d-48d0-b02d-31d4f6309667 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:02.014645 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-34473041-0a1d-48d0-b02d-31d4f6309667 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:02.015834 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-34473041-0a1d-48d0-b02d-31d4f6309667 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.194186 Jun 27 15:30:02.016418 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 229/465] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:30:01 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:30:02.171874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-893a5536-96b9-4fea-b85b-d2a2b25ae1b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:02.173381 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-893a5536-96b9-4fea-b85b-d2a2b25ae1b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:02.181695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-893a5536-96b9-4fea-b85b-d2a2b25ae1b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:02.182884 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-893a5536-96b9-4fea-b85b-d2a2b25ae1b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:02.184683 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-893a5536-96b9-4fea-b85b-d2a2b25ae1b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:02.185203 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-893a5536-96b9-4fea-b85b-d2a2b25ae1b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:02.286826 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-893a5536-96b9-4fea-b85b-d2a2b25ae1b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:02.302238 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-893a5536-96b9-4fea-b85b-d2a2b25ae1b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1246 microversion: 2.1 time: 0.135665 Jun 27 15:30:02.313356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 230/466] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:02 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1246 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:02.313356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-0b037f42-3389-446f-a663-5a063fd80f43 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:02.314849 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-0b037f42-3389-446f-a663-5a063fd80f43 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:02.327943 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0b037f42-3389-446f-a663-5a063fd80f43 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:02.328748 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0b037f42-3389-446f-a663-5a063fd80f43 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:02.330062 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0b037f42-3389-446f-a663-5a063fd80f43 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:02.331143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0b037f42-3389-446f-a663-5a063fd80f43 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:02.521378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-0b037f42-3389-446f-a663-5a063fd80f43 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:02.529291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-0b037f42-3389-446f-a663-5a063fd80f43 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.224135 Jun 27 15:30:02.529871 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 231/467] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:02 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:02.573816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d79e8d0c-ff25-4741-b7d3-b3c69a3fe2a6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "POST /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.796573 Jun 27 15:30:02.574919 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 237/468] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:30:01 2022] POST /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments => generated 194 bytes in 798 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:30:02.815959 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-689b76cf-d88e-4196-b083-631d8fa99850 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:02.823124 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-689b76cf-d88e-4196-b083-631d8fa99850 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:02.824013 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-689b76cf-d88e-4196-b083-631d8fa99850 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:02.858199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-689b76cf-d88e-4196-b083-631d8fa99850 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Going to try to stop instance {{(pid=117977) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 15:30:02.966441 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-689b76cf-d88e-4196-b083-631d8fa99850 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/action" status: 202 len: 0 microversion: 2.1 time: 0.154587 Jun 27 15:30:02.967856 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 232/469] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:30:02 2022] POST /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/action => generated 0 bytes in 157 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:30:02.978606 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e3c46d3a-e582-4e69-ad3b-05d4644dbee8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:02.979417 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e3c46d3a-e582-4e69-ad3b-05d4644dbee8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:02.988546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c46d3a-e582-4e69-ad3b-05d4644dbee8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:02.989292 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c46d3a-e582-4e69-ad3b-05d4644dbee8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:02.990550 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c46d3a-e582-4e69-ad3b-05d4644dbee8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:02.991219 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c46d3a-e582-4e69-ad3b-05d4644dbee8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:03.029174 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-34575094-b0cd-40ab-b959-2dbd9b1a13b5 req-98dc3803-e214-462a-9623-672f36a9b5f9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2cf58f-7730-4d52-8712-24fcfbf19801", "name": "network-vif-plugged", "status": "completed", "tag": "684b638a-b884-40ba-bebd-043ddafe9556"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:03.038599 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-34575094-b0cd-40ab-b959-2dbd9b1a13b5 req-98dc3803-e214-462a-9623-672f36a9b5f9 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:03.039042 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-34575094-b0cd-40ab-b959-2dbd9b1a13b5 req-98dc3803-e214-462a-9623-672f36a9b5f9 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:03.053331 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-34575094-b0cd-40ab-b959-2dbd9b1a13b5 req-98dc3803-e214-462a-9623-672f36a9b5f9 service nova] Creating event network-vif-plugged:684b638a-b884-40ba-bebd-043ddafe9556 for instance 5e2cf58f-7730-4d52-8712-24fcfbf19801 on hv-cinder-84779 Jun 27 15:30:03.058849 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-34575094-b0cd-40ab-b959-2dbd9b1a13b5 req-98dc3803-e214-462a-9623-672f36a9b5f9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033304 Jun 27 15:30:03.059817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 233/470] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:30:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:30:03.077326 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6d9bde8a-4cc5-4ee8-b139-5d3d931e253c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:03.078040 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-6d9bde8a-4cc5-4ee8-b139-5d3d931e253c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:03.088530 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d9bde8a-4cc5-4ee8-b139-5d3d931e253c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:03.099832 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d9bde8a-4cc5-4ee8-b139-5d3d931e253c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:03.100856 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d9bde8a-4cc5-4ee8-b139-5d3d931e253c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:03.101321 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d9bde8a-4cc5-4ee8-b139-5d3d931e253c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:03.219998 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e3c46d3a-e582-4e69-ad3b-05d4644dbee8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:03.230941 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e3c46d3a-e582-4e69-ad3b-05d4644dbee8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.257875 Jun 27 15:30:03.231870 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 238/471] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:02 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:03.331452 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6cf0095b-c027-4e89-9d9e-6e282d0e28f2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:03.332668 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6cf0095b-c027-4e89-9d9e-6e282d0e28f2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:03.343552 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cf0095b-c027-4e89-9d9e-6e282d0e28f2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:03.344163 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cf0095b-c027-4e89-9d9e-6e282d0e28f2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:03.345036 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cf0095b-c027-4e89-9d9e-6e282d0e28f2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:03.345601 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6cf0095b-c027-4e89-9d9e-6e282d0e28f2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:03.428051 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6cf0095b-c027-4e89-9d9e-6e282d0e28f2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:03.439133 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6cf0095b-c027-4e89-9d9e-6e282d0e28f2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1300 microversion: 2.1 time: 0.111488 Jun 27 15:30:03.440274 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 239/472] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:03 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:03.495416 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6d9bde8a-4cc5-4ee8-b139-5d3d931e253c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:03.507158 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6d9bde8a-4cc5-4ee8-b139-5d3d931e253c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:03.508709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6d9bde8a-4cc5-4ee8-b139-5d3d931e253c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:03.509943 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-6d9bde8a-4cc5-4ee8-b139-5d3d931e253c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.447350 Jun 27 15:30:03.510671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 234/473] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:30:03 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:30:03.548011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-962bb6e3-beec-469e-9b25-535c38ad037b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:03.548718 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-962bb6e3-beec-469e-9b25-535c38ad037b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:03.556443 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-962bb6e3-beec-469e-9b25-535c38ad037b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:03.557126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-962bb6e3-beec-469e-9b25-535c38ad037b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:03.557909 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-962bb6e3-beec-469e-9b25-535c38ad037b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:03.558709 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-962bb6e3-beec-469e-9b25-535c38ad037b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:03.699806 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-962bb6e3-beec-469e-9b25-535c38ad037b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:03.709129 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-962bb6e3-beec-469e-9b25-535c38ad037b tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.165698 Jun 27 15:30:03.709835 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 240/474] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:03 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:04.254871 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-eb32cd2b-1a40-46ca-85f9-e052914c610d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:04.255782 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-eb32cd2b-1a40-46ca-85f9-e052914c610d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:04.268077 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eb32cd2b-1a40-46ca-85f9-e052914c610d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:04.268077 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eb32cd2b-1a40-46ca-85f9-e052914c610d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:04.268477 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eb32cd2b-1a40-46ca-85f9-e052914c610d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:04.269608 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eb32cd2b-1a40-46ca-85f9-e052914c610d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:04.460400 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f261ab19-c121-463b-986a-0f9235891418 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:04.461227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f261ab19-c121-463b-986a-0f9235891418 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:04.475655 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f261ab19-c121-463b-986a-0f9235891418 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:04.476261 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f261ab19-c121-463b-986a-0f9235891418 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:04.477776 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f261ab19-c121-463b-986a-0f9235891418 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:04.478363 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f261ab19-c121-463b-986a-0f9235891418 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:04.556946 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-eb32cd2b-1a40-46ca-85f9-e052914c610d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:04.566396 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-eb32cd2b-1a40-46ca-85f9-e052914c610d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.319053 Jun 27 15:30:04.576820 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 235/475] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:04 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:04.583143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5c082504-3a09-40af-b800-d49115a06e9a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:04.587103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5c082504-3a09-40af-b800-d49115a06e9a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:04.597347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5c082504-3a09-40af-b800-d49115a06e9a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:04.597610 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5c082504-3a09-40af-b800-d49115a06e9a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:04.598459 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5c082504-3a09-40af-b800-d49115a06e9a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:04.598964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5c082504-3a09-40af-b800-d49115a06e9a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:04.690574 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f261ab19-c121-463b-986a-0f9235891418 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:04.693700 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:04.702035 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f261ab19-c121-463b-986a-0f9235891418 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1368 microversion: 2.1 time: 0.245515 Jun 27 15:30:04.703669 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 241/476] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:04 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:04.728748 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-244c7743-7b40-4233-846d-447dcb01dc35 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:04.729419 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-244c7743-7b40-4233-846d-447dcb01dc35 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:04.739281 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-244c7743-7b40-4233-846d-447dcb01dc35 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:04.739765 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-244c7743-7b40-4233-846d-447dcb01dc35 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:04.740636 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-244c7743-7b40-4233-846d-447dcb01dc35 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:04.741108 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-244c7743-7b40-4233-846d-447dcb01dc35 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:04.868013 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5c082504-3a09-40af-b800-d49115a06e9a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:04.878104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5c082504-3a09-40af-b800-d49115a06e9a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:04.879936 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5c082504-3a09-40af-b800-d49115a06e9a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:04.881343 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5c082504-3a09-40af-b800-d49115a06e9a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.303016 Jun 27 15:30:04.892739 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 236/477] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:30:04 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:30:04.914029 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-244c7743-7b40-4233-846d-447dcb01dc35 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:04.921679 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-244c7743-7b40-4233-846d-447dcb01dc35 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1318 microversion: 2.1 time: 0.198728 Jun 27 15:30:04.931286 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 242/478] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:04 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:05.346605 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-02c76de4-4714-4c53-a000-e1c5d3e15105 req-72bb6bcc-058e-4926-97e2-1a7d9b18eb92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b669df6d-2c11-4910-bdc8-0eb82915b879", "tag": "6903c7d7-bfc1-4974-9767-47e90c255031"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:05.355097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-02c76de4-4714-4c53-a000-e1c5d3e15105 req-72bb6bcc-058e-4926-97e2-1a7d9b18eb92 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:05.355718 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-02c76de4-4714-4c53-a000-e1c5d3e15105 req-72bb6bcc-058e-4926-97e2-1a7d9b18eb92 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:05.370947 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-02c76de4-4714-4c53-a000-e1c5d3e15105 req-72bb6bcc-058e-4926-97e2-1a7d9b18eb92 service nova] Creating event network-changed:6903c7d7-bfc1-4974-9767-47e90c255031 for instance b669df6d-2c11-4910-bdc8-0eb82915b879 on hv-cinder-84779 Jun 27 15:30:05.376054 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-02c76de4-4714-4c53-a000-e1c5d3e15105 req-72bb6bcc-058e-4926-97e2-1a7d9b18eb92 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034396 Jun 27 15:30:05.377227 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 237/479] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:30:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:30:05.595073 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a9fd6984-771d-4bed-94fb-946b83e1cbc2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:05.595835 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a9fd6984-771d-4bed-94fb-946b83e1cbc2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:05.602287 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a9fd6984-771d-4bed-94fb-946b83e1cbc2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:05.602988 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a9fd6984-771d-4bed-94fb-946b83e1cbc2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:05.614659 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a9fd6984-771d-4bed-94fb-946b83e1cbc2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:05.615393 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a9fd6984-771d-4bed-94fb-946b83e1cbc2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:05.722398 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-77686119-6191-40c1-a054-11a35995630d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:05.723247 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-77686119-6191-40c1-a054-11a35995630d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:05.730628 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77686119-6191-40c1-a054-11a35995630d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:05.731072 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77686119-6191-40c1-a054-11a35995630d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:05.732001 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77686119-6191-40c1-a054-11a35995630d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:05.732754 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77686119-6191-40c1-a054-11a35995630d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:05.786213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a9fd6984-771d-4bed-94fb-946b83e1cbc2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:05.799298 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a9fd6984-771d-4bed-94fb-946b83e1cbc2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.207271 Jun 27 15:30:05.800546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 243/480] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:05 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:05.907132 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ac0738b8-1378-42b4-828f-bcc6c1224f06 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:05.908613 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ac0738b8-1378-42b4-828f-bcc6c1224f06 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:05.915886 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac0738b8-1378-42b4-828f-bcc6c1224f06 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:05.916394 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac0738b8-1378-42b4-828f-bcc6c1224f06 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:05.917289 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac0738b8-1378-42b4-828f-bcc6c1224f06 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:05.917725 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ac0738b8-1378-42b4-828f-bcc6c1224f06 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:05.975864 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-77686119-6191-40c1-a054-11a35995630d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:05.987614 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-77686119-6191-40c1-a054-11a35995630d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1368 microversion: 2.1 time: 0.269743 Jun 27 15:30:05.993969 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 238/481] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:05 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1368 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:05.998706 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9d142d8f-5e32-44eb-b230-95bca97f0e57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:06.000806 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9d142d8f-5e32-44eb-b230-95bca97f0e57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:06.011648 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d142d8f-5e32-44eb-b230-95bca97f0e57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:06.012168 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d142d8f-5e32-44eb-b230-95bca97f0e57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:06.013137 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d142d8f-5e32-44eb-b230-95bca97f0e57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:06.013599 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d142d8f-5e32-44eb-b230-95bca97f0e57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:06.070285 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ac0738b8-1378-42b4-828f-bcc6c1224f06 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:06.079846 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ac0738b8-1378-42b4-828f-bcc6c1224f06 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:06.081527 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ac0738b8-1378-42b4-828f-bcc6c1224f06 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:06.082810 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ac0738b8-1378-42b4-828f-bcc6c1224f06 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.186394 Jun 27 15:30:06.083461 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 244/482] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:30:05 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:30:06.243287 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9d142d8f-5e32-44eb-b230-95bca97f0e57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:06.251171 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9d142d8f-5e32-44eb-b230-95bca97f0e57 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1508 microversion: 2.1 time: 0.260393 Jun 27 15:30:06.257915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 239/483] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:05 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1508 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:06.824545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bc3ffc3d-a606-466d-bdb8-d629c268700d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:06.825169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bc3ffc3d-a606-466d-bdb8-d629c268700d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:06.834409 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bc3ffc3d-a606-466d-bdb8-d629c268700d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:06.834853 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bc3ffc3d-a606-466d-bdb8-d629c268700d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:06.838427 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bc3ffc3d-a606-466d-bdb8-d629c268700d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:06.840342 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bc3ffc3d-a606-466d-bdb8-d629c268700d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:07.011230 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-41921171-987d-4aba-9290-cde0753edafd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:07.011706 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-41921171-987d-4aba-9290-cde0753edafd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:07.020835 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41921171-987d-4aba-9290-cde0753edafd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:07.021487 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41921171-987d-4aba-9290-cde0753edafd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:07.022508 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41921171-987d-4aba-9290-cde0753edafd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:07.023104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41921171-987d-4aba-9290-cde0753edafd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:07.173238 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bc3ffc3d-a606-466d-bdb8-d629c268700d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:07.188099 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bc3ffc3d-a606-466d-bdb8-d629c268700d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.367059 Jun 27 15:30:07.189728 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 245/484] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:06 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:07.199151 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-12e3ff51-156b-4d8a-aa39-9dd538bd6ce6 req-d66a76da-fa3a-4570-805b-bc11203ea94c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831291d0-f04d-4927-afcd-88fd058db642", "name": "network-vif-plugged", "status": "completed", "tag": "62696634-23e0-4313-bcf8-d3be6665d3aa"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:07.215012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-12e3ff51-156b-4d8a-aa39-9dd538bd6ce6 req-d66a76da-fa3a-4570-805b-bc11203ea94c service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:07.216452 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-12e3ff51-156b-4d8a-aa39-9dd538bd6ce6 req-d66a76da-fa3a-4570-805b-bc11203ea94c service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:07.228351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-41921171-987d-4aba-9290-cde0753edafd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:07.247906 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-41921171-987d-4aba-9290-cde0753edafd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1368 microversion: 2.1 time: 0.245094 Jun 27 15:30:07.249333 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 240/485] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:07 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1368 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:07.255377 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-12e3ff51-156b-4d8a-aa39-9dd538bd6ce6 req-d66a76da-fa3a-4570-805b-bc11203ea94c service nova] Creating event network-vif-plugged:62696634-23e0-4313-bcf8-d3be6665d3aa for instance 831291d0-f04d-4927-afcd-88fd058db642 on hv-cinder-84779 Jun 27 15:30:07.264002 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-25c832ee-efac-4281-a859-ebe74b4b1d3e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:07.265146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-25c832ee-efac-4281-a859-ebe74b4b1d3e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:07.275893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-12e3ff51-156b-4d8a-aa39-9dd538bd6ce6 req-d66a76da-fa3a-4570-805b-bc11203ea94c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.083546 Jun 27 15:30:07.277380 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 246/486] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:30:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:30:07.285124 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-25c832ee-efac-4281-a859-ebe74b4b1d3e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:07.286168 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-25c832ee-efac-4281-a859-ebe74b4b1d3e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:07.287300 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-25c832ee-efac-4281-a859-ebe74b4b1d3e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:07.288902 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-25c832ee-efac-4281-a859-ebe74b4b1d3e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:07.460635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-25c832ee-efac-4281-a859-ebe74b4b1d3e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:07.469782 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-25c832ee-efac-4281-a859-ebe74b4b1d3e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:07.471396 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-25c832ee-efac-4281-a859-ebe74b4b1d3e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:07.472622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-25c832ee-efac-4281-a859-ebe74b4b1d3e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.221022 Jun 27 15:30:07.473181 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 241/487] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:30:07 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:30:08.218457 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7f3a0c9c-bcbc-447b-a1b2-7512f45ea7e6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:08.219141 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7f3a0c9c-bcbc-447b-a1b2-7512f45ea7e6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:08.226224 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f3a0c9c-bcbc-447b-a1b2-7512f45ea7e6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:08.226749 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f3a0c9c-bcbc-447b-a1b2-7512f45ea7e6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:08.227601 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f3a0c9c-bcbc-447b-a1b2-7512f45ea7e6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:08.228147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f3a0c9c-bcbc-447b-a1b2-7512f45ea7e6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:08.267565 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-37ae76b8-6d41-42ca-8902-80f1eb9959c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:08.269115 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-37ae76b8-6d41-42ca-8902-80f1eb9959c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:08.275587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-37ae76b8-6d41-42ca-8902-80f1eb9959c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:08.276356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-37ae76b8-6d41-42ca-8902-80f1eb9959c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:08.277157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-37ae76b8-6d41-42ca-8902-80f1eb9959c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:08.277592 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-37ae76b8-6d41-42ca-8902-80f1eb9959c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:08.381443 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7f3a0c9c-bcbc-447b-a1b2-7512f45ea7e6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:08.389681 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7f3a0c9c-bcbc-447b-a1b2-7512f45ea7e6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.176926 Jun 27 15:30:08.390260 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 247/488] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:08 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:08.456914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-37ae76b8-6d41-42ca-8902-80f1eb9959c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:08.465707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-37ae76b8-6d41-42ca-8902-80f1eb9959c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1368 microversion: 2.1 time: 0.201932 Jun 27 15:30:08.466290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 242/489] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:08 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:08.498257 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d1c4a6c2-a547-45fe-9192-eb5ae57d0173 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:08.498888 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d1c4a6c2-a547-45fe-9192-eb5ae57d0173 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:08.505930 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1c4a6c2-a547-45fe-9192-eb5ae57d0173 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:08.506348 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1c4a6c2-a547-45fe-9192-eb5ae57d0173 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:08.507111 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1c4a6c2-a547-45fe-9192-eb5ae57d0173 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:08.507538 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d1c4a6c2-a547-45fe-9192-eb5ae57d0173 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:08.660524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d1c4a6c2-a547-45fe-9192-eb5ae57d0173 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:08.669243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d1c4a6c2-a547-45fe-9192-eb5ae57d0173 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:08.670813 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d1c4a6c2-a547-45fe-9192-eb5ae57d0173 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:08.671998 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d1c4a6c2-a547-45fe-9192-eb5ae57d0173 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.177657 Jun 27 15:30:08.672589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 248/490] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:30:08 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:30:09.407781 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a735502a-301b-4ebf-bbcf-8bc2d5577755 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:09.408807 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a735502a-301b-4ebf-bbcf-8bc2d5577755 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:09.415259 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a735502a-301b-4ebf-bbcf-8bc2d5577755 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:09.415712 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a735502a-301b-4ebf-bbcf-8bc2d5577755 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:09.416511 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a735502a-301b-4ebf-bbcf-8bc2d5577755 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:09.416950 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a735502a-301b-4ebf-bbcf-8bc2d5577755 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:09.483703 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-620175a5-c8e8-45e3-a536-c3e777efa14c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:09.484389 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-620175a5-c8e8-45e3-a536-c3e777efa14c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:09.492438 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-620175a5-c8e8-45e3-a536-c3e777efa14c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:09.493222 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-620175a5-c8e8-45e3-a536-c3e777efa14c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:09.494231 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-620175a5-c8e8-45e3-a536-c3e777efa14c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:09.494723 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-620175a5-c8e8-45e3-a536-c3e777efa14c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:09.563140 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a735502a-301b-4ebf-bbcf-8bc2d5577755 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:09.572597 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a735502a-301b-4ebf-bbcf-8bc2d5577755 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.168988 Jun 27 15:30:09.573211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 243/491] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:09 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:09.638307 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-620175a5-c8e8-45e3-a536-c3e777efa14c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:09.646311 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-620175a5-c8e8-45e3-a536-c3e777efa14c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1368 microversion: 2.1 time: 0.166984 Jun 27 15:30:09.646859 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 249/492] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:09 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:09.692067 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a5b27717-2f99-446b-a4fa-32c5dda73a9e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:09.692721 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a5b27717-2f99-446b-a4fa-32c5dda73a9e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:09.700622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a5b27717-2f99-446b-a4fa-32c5dda73a9e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:09.701069 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a5b27717-2f99-446b-a4fa-32c5dda73a9e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:09.701850 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a5b27717-2f99-446b-a4fa-32c5dda73a9e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:09.702285 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a5b27717-2f99-446b-a4fa-32c5dda73a9e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:09.857341 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a5b27717-2f99-446b-a4fa-32c5dda73a9e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:09.866591 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a5b27717-2f99-446b-a4fa-32c5dda73a9e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:09.868305 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a5b27717-2f99-446b-a4fa-32c5dda73a9e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:09.869568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a5b27717-2f99-446b-a4fa-32c5dda73a9e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.182333 Jun 27 15:30:09.870120 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 244/493] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:30:09 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:30:10.590157 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-401958ad-04ad-47d5-a6e9-02c02d2fdc17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:10.590767 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-401958ad-04ad-47d5-a6e9-02c02d2fdc17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:10.598655 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-401958ad-04ad-47d5-a6e9-02c02d2fdc17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:10.599104 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-401958ad-04ad-47d5-a6e9-02c02d2fdc17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:10.599884 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-401958ad-04ad-47d5-a6e9-02c02d2fdc17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:10.600310 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-401958ad-04ad-47d5-a6e9-02c02d2fdc17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:10.664181 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3020a1f6-4b1a-4ae0-aea1-e7707273f2b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:10.664834 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3020a1f6-4b1a-4ae0-aea1-e7707273f2b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:10.680271 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3020a1f6-4b1a-4ae0-aea1-e7707273f2b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:10.680703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3020a1f6-4b1a-4ae0-aea1-e7707273f2b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:10.681777 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3020a1f6-4b1a-4ae0-aea1-e7707273f2b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:10.682120 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3020a1f6-4b1a-4ae0-aea1-e7707273f2b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:10.699294 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:10.767803 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-401958ad-04ad-47d5-a6e9-02c02d2fdc17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:10.777973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-401958ad-04ad-47d5-a6e9-02c02d2fdc17 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.191606 Jun 27 15:30:10.785424 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 250/494] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:10 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:10.828455 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3020a1f6-4b1a-4ae0-aea1-e7707273f2b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:10.837474 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3020a1f6-4b1a-4ae0-aea1-e7707273f2b6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1368 microversion: 2.1 time: 0.177275 Jun 27 15:30:10.837984 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 245/495] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:10 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1368 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:10.889538 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-64f72550-2f2b-4a75-96e4-46326c0e3815 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:10.890615 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-64f72550-2f2b-4a75-96e4-46326c0e3815 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:10.906111 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64f72550-2f2b-4a75-96e4-46326c0e3815 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:10.908009 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64f72550-2f2b-4a75-96e4-46326c0e3815 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:10.910111 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64f72550-2f2b-4a75-96e4-46326c0e3815 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:10.911283 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64f72550-2f2b-4a75-96e4-46326c0e3815 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:10.969575 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:10.990649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-a31d0b30-f297-47e3-9b0c-9a62df34ce18 req-0620fa32-e790-477b-a49c-df802e944e18 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b669df6d-2c11-4910-bdc8-0eb82915b879", "name": "network-vif-plugged", "status": "completed", "tag": "6903c7d7-bfc1-4974-9767-47e90c255031"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:11.010799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-a31d0b30-f297-47e3-9b0c-9a62df34ce18 req-0620fa32-e790-477b-a49c-df802e944e18 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:11.011307 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-a31d0b30-f297-47e3-9b0c-9a62df34ce18 req-0620fa32-e790-477b-a49c-df802e944e18 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:11.032970 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-a31d0b30-f297-47e3-9b0c-9a62df34ce18 req-0620fa32-e790-477b-a49c-df802e944e18 service nova] Creating event network-vif-plugged:6903c7d7-bfc1-4974-9767-47e90c255031 for instance b669df6d-2c11-4910-bdc8-0eb82915b879 on hv-cinder-84779 Jun 27 15:30:11.039201 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-a31d0b30-f297-47e3-9b0c-9a62df34ce18 req-0620fa32-e790-477b-a49c-df802e944e18 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052843 Jun 27 15:30:11.040058 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 246/496] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:30:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:30:11.074394 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-64f72550-2f2b-4a75-96e4-46326c0e3815 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:11.084158 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-64f72550-2f2b-4a75-96e4-46326c0e3815 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:11.085744 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-64f72550-2f2b-4a75-96e4-46326c0e3815 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:11.086973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-64f72550-2f2b-4a75-96e4-46326c0e3815 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1807 microversion: 2.20 time: 0.203222 Jun 27 15:30:11.087528 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 251/497] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:30:10 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:30:11.797457 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ee87fc16-eaf5-4fb0-8360-d8e97528705b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:11.798140 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ee87fc16-eaf5-4fb0-8360-d8e97528705b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:11.805027 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ee87fc16-eaf5-4fb0-8360-d8e97528705b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:11.805970 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ee87fc16-eaf5-4fb0-8360-d8e97528705b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:11.806451 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ee87fc16-eaf5-4fb0-8360-d8e97528705b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:11.806912 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ee87fc16-eaf5-4fb0-8360-d8e97528705b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:11.855565 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-99ad9799-7cbe-445a-924c-b6f325e6ae03 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:11.856180 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-99ad9799-7cbe-445a-924c-b6f325e6ae03 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:11.858158 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=12 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:11.864882 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99ad9799-7cbe-445a-924c-b6f325e6ae03 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:11.865335 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99ad9799-7cbe-445a-924c-b6f325e6ae03 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:11.866136 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99ad9799-7cbe-445a-924c-b6f325e6ae03 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:11.866568 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-99ad9799-7cbe-445a-924c-b6f325e6ae03 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:11.955411 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ee87fc16-eaf5-4fb0-8360-d8e97528705b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:11.963501 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ee87fc16-eaf5-4fb0-8360-d8e97528705b tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.170543 Jun 27 15:30:11.964379 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 247/498] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:11 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:12.024515 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-99ad9799-7cbe-445a-924c-b6f325e6ae03 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:12.032219 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-99ad9799-7cbe-445a-924c-b6f325e6ae03 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1368 microversion: 2.1 time: 0.181307 Jun 27 15:30:12.032843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 252/499] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:11 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1368 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:12.107188 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2df2dc91-053e-4687-81dd-ea74123e80dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:12.107188 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2df2dc91-053e-4687-81dd-ea74123e80dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:12.112733 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2df2dc91-053e-4687-81dd-ea74123e80dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:12.113185 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2df2dc91-053e-4687-81dd-ea74123e80dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:12.113974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2df2dc91-053e-4687-81dd-ea74123e80dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:12.114406 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2df2dc91-053e-4687-81dd-ea74123e80dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:12.252367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2df2dc91-053e-4687-81dd-ea74123e80dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:12.261810 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2df2dc91-053e-4687-81dd-ea74123e80dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:12.263578 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2df2dc91-053e-4687-81dd-ea74123e80dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:12.265291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2df2dc91-053e-4687-81dd-ea74123e80dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1794 microversion: 2.20 time: 0.163786 Jun 27 15:30:12.265849 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 248/500] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:30:12 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1794 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:30:12.438452 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4c8a5019-c548-4f96-9938-c68d9351fd20 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:12.439034 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4c8a5019-c548-4f96-9938-c68d9351fd20 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:12.445893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c8a5019-c548-4f96-9938-c68d9351fd20 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:12.446353 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c8a5019-c548-4f96-9938-c68d9351fd20 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:12.447121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c8a5019-c548-4f96-9938-c68d9351fd20 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:12.447602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c8a5019-c548-4f96-9938-c68d9351fd20 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:12.586656 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4c8a5019-c548-4f96-9938-c68d9351fd20 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:12.595021 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4c8a5019-c548-4f96-9938-c68d9351fd20 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1593 microversion: 2.1 time: 0.160370 Jun 27 15:30:12.596612 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 253/501] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:12 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1593 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:12.981658 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-03c3656d-330f-4cd0-8814-4c247c5a5dea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:12.982585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-03c3656d-330f-4cd0-8814-4c247c5a5dea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:12.990811 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03c3656d-330f-4cd0-8814-4c247c5a5dea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:12.991269 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03c3656d-330f-4cd0-8814-4c247c5a5dea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:12.992053 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03c3656d-330f-4cd0-8814-4c247c5a5dea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:12.992524 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03c3656d-330f-4cd0-8814-4c247c5a5dea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:13.052197 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d436a75b-faa3-4dfa-a98c-4f07c84fc124 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:13.053375 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d436a75b-faa3-4dfa-a98c-4f07c84fc124 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:13.061977 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d436a75b-faa3-4dfa-a98c-4f07c84fc124 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:13.062425 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d436a75b-faa3-4dfa-a98c-4f07c84fc124 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:13.064142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d436a75b-faa3-4dfa-a98c-4f07c84fc124 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:13.064142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d436a75b-faa3-4dfa-a98c-4f07c84fc124 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:13.254376 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d436a75b-faa3-4dfa-a98c-4f07c84fc124 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:13.262855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d436a75b-faa3-4dfa-a98c-4f07c84fc124 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1368 microversion: 2.1 time: 0.215107 Jun 27 15:30:13.263443 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 254/502] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:13 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1368 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:13.265887 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-03c3656d-330f-4cd0-8814-4c247c5a5dea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:13.274274 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-03c3656d-330f-4cd0-8814-4c247c5a5dea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.296537 Jun 27 15:30:13.274864 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 249/503] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:12 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:14.286674 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-62bc6615-b4f7-454a-8cd3-eaa5cc666388 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:14.287521 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-62bc6615-b4f7-454a-8cd3-eaa5cc666388 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:14.295875 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-62bc6615-b4f7-454a-8cd3-eaa5cc666388 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:14.296306 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-62bc6615-b4f7-454a-8cd3-eaa5cc666388 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:14.297307 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-62bc6615-b4f7-454a-8cd3-eaa5cc666388 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:14.297479 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b93a9555-d200-4ff3-aa76-52754667fab0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:14.298212 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-62bc6615-b4f7-454a-8cd3-eaa5cc666388 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:14.299621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b93a9555-d200-4ff3-aa76-52754667fab0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:14.310008 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b93a9555-d200-4ff3-aa76-52754667fab0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:14.311043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b93a9555-d200-4ff3-aa76-52754667fab0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:14.312116 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b93a9555-d200-4ff3-aa76-52754667fab0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:14.313055 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b93a9555-d200-4ff3-aa76-52754667fab0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:14.478636 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-62bc6615-b4f7-454a-8cd3-eaa5cc666388 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:14.486654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-62bc6615-b4f7-454a-8cd3-eaa5cc666388 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1557 microversion: 2.1 time: 0.204807 Jun 27 15:30:14.487458 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 255/504] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:14 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1557 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:14.504825 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3d381d18-375f-4b86-b3d6-1789fc84c656 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:14.505367 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3d381d18-375f-4b86-b3d6-1789fc84c656 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:14.512835 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d381d18-375f-4b86-b3d6-1789fc84c656 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:14.513576 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d381d18-375f-4b86-b3d6-1789fc84c656 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:14.514376 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d381d18-375f-4b86-b3d6-1789fc84c656 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:14.514814 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d381d18-375f-4b86-b3d6-1789fc84c656 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:14.540470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b93a9555-d200-4ff3-aa76-52754667fab0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:14.562355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b93a9555-d200-4ff3-aa76-52754667fab0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.270157 Jun 27 15:30:14.564343 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 250/505] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:14 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:14.609832 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3d381d18-375f-4b86-b3d6-1789fc84c656 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.109370 Jun 27 15:30:14.610422 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 256/506] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jun 27 15:30:14 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:30:15.581739 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7e88c13b-3aae-4a76-87ff-2ea4a1caa7b1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:15.582313 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7e88c13b-3aae-4a76-87ff-2ea4a1caa7b1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:15.589649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e88c13b-3aae-4a76-87ff-2ea4a1caa7b1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:15.590104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e88c13b-3aae-4a76-87ff-2ea4a1caa7b1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:15.591001 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e88c13b-3aae-4a76-87ff-2ea4a1caa7b1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:15.591442 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7e88c13b-3aae-4a76-87ff-2ea4a1caa7b1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:15.989081 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-e970f433-9399-46e2-ba2a-6d7b3829b862 req-c3adeca4-fdfb-4015-9cf9-69719305341a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5aa595-85d6-44d8-9b6a-0fd0e958657c", "tag": "3ccbca6d-373a-42a6-9d88-221bb0b77dd5"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:16.002246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7e88c13b-3aae-4a76-87ff-2ea4a1caa7b1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:16.012177 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-e970f433-9399-46e2-ba2a-6d7b3829b862 req-c3adeca4-fdfb-4015-9cf9-69719305341a service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:16.013937 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-e970f433-9399-46e2-ba2a-6d7b3829b862 req-c3adeca4-fdfb-4015-9cf9-69719305341a service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:16.022443 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7e88c13b-3aae-4a76-87ff-2ea4a1caa7b1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.443736 Jun 27 15:30:16.024080 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 251/507] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:15 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:16.036376 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-e970f433-9399-46e2-ba2a-6d7b3829b862 req-c3adeca4-fdfb-4015-9cf9-69719305341a service nova] Creating event network-changed:3ccbca6d-373a-42a6-9d88-221bb0b77dd5 for instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c on hv-cinder-84779 Jun 27 15:30:16.043837 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-e970f433-9399-46e2-ba2a-6d7b3829b862 req-c3adeca4-fdfb-4015-9cf9-69719305341a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060862 Jun 27 15:30:16.045280 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 257/508] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:30:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:30:16.890631 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-cc660b42-b01d-4d1c-8f43-edd18458e04d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "66ade38e-6d5a-444c-8c26-288eb44208a3"}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:16.895712 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-cc660b42-b01d-4d1c-8f43-edd18458e04d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:16.911453 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc660b42-b01d-4d1c-8f43-edd18458e04d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:16.912484 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc660b42-b01d-4d1c-8f43-edd18458e04d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:16.913558 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc660b42-b01d-4d1c-8f43-edd18458e04d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:16.914036 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc660b42-b01d-4d1c-8f43-edd18458e04d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:17.041526 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-23ce9c92-5162-450f-8218-3ef4d02c837c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:17.042379 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-23ce9c92-5162-450f-8218-3ef4d02c837c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:17.055327 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23ce9c92-5162-450f-8218-3ef4d02c837c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:17.067526 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23ce9c92-5162-450f-8218-3ef4d02c837c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:17.069000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23ce9c92-5162-450f-8218-3ef4d02c837c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:17.069477 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-23ce9c92-5162-450f-8218-3ef4d02c837c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:17.372602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-23ce9c92-5162-450f-8218-3ef4d02c837c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:17.384984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-23ce9c92-5162-450f-8218-3ef4d02c837c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.347243 Jun 27 15:30:17.386200 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 258/509] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:17 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:17.388461 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-cc660b42-b01d-4d1c-8f43-edd18458e04d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.503089 Jun 27 15:30:17.408472 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 252/510] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:30:16 2022] POST /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments => generated 194 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:30:17.711304 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9782f2f9-70c2-4500-a5a8-9713a4efd99c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-717478751"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:17.712013 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9782f2f9-70c2-4500-a5a8-9713a4efd99c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:17.718203 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9782f2f9-70c2-4500-a5a8-9713a4efd99c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:17.718638 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9782f2f9-70c2-4500-a5a8-9713a4efd99c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:17.719397 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9782f2f9-70c2-4500-a5a8-9713a4efd99c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:17.719995 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9782f2f9-70c2-4500-a5a8-9713a4efd99c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:17.852388 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.network.security_group_api [None req-9782f2f9-70c2-4500-a5a8-9713a4efd99c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Adding security group 09e21af3-79db-4833-950a-21c92d53c1a9 to port 3ccbca6d-373a-42a6-9d88-221bb0b77dd5 Jun 27 15:30:18.061074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-b904fa74-4374-4e36-ae2a-ff45a8ff7d7a req-c2edc2b4-e5bc-43af-94be-ffc1b0e28a6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b669df6d-2c11-4910-bdc8-0eb82915b879", "tag": "6903c7d7-bfc1-4974-9767-47e90c255031"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:18.070126 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-b904fa74-4374-4e36-ae2a-ff45a8ff7d7a req-c2edc2b4-e5bc-43af-94be-ffc1b0e28a6d service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:18.070581 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-b904fa74-4374-4e36-ae2a-ff45a8ff7d7a req-c2edc2b4-e5bc-43af-94be-ffc1b0e28a6d service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:18.083249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-b904fa74-4374-4e36-ae2a-ff45a8ff7d7a req-c2edc2b4-e5bc-43af-94be-ffc1b0e28a6d service nova] Creating event network-changed:6903c7d7-bfc1-4974-9767-47e90c255031 for instance b669df6d-2c11-4910-bdc8-0eb82915b879 on hv-cinder-84779 Jun 27 15:30:18.088260 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-b904fa74-4374-4e36-ae2a-ff45a8ff7d7a req-c2edc2b4-e5bc-43af-94be-ffc1b0e28a6d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032462 Jun 27 15:30:18.092144 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 253/511] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:30:18.301938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9782f2f9-70c2-4500-a5a8-9713a4efd99c tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "POST /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/action" status: 202 len: 0 microversion: 2.1 time: 0.594608 Jun 27 15:30:18.302618 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 259/512] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:30:17 2022] POST /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:30:18.333656 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ab0683b5-4552-42a0-8ff1-91370565a41a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:18.334839 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ab0683b5-4552-42a0-8ff1-91370565a41a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:18.338173 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-57226ea6-9a6e-4884-bbb6-f829ef7c233e req-6bb16127-caf5-4c75-b6f9-1cf8f5335273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5aa595-85d6-44d8-9b6a-0fd0e958657c", "tag": "3ccbca6d-373a-42a6-9d88-221bb0b77dd5"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:18.351025 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab0683b5-4552-42a0-8ff1-91370565a41a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:18.364295 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab0683b5-4552-42a0-8ff1-91370565a41a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:18.367784 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab0683b5-4552-42a0-8ff1-91370565a41a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:18.368705 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab0683b5-4552-42a0-8ff1-91370565a41a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:18.374320 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-57226ea6-9a6e-4884-bbb6-f829ef7c233e req-6bb16127-caf5-4c75-b6f9-1cf8f5335273 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:18.375126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-57226ea6-9a6e-4884-bbb6-f829ef7c233e req-6bb16127-caf5-4c75-b6f9-1cf8f5335273 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:18.397363 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-57226ea6-9a6e-4884-bbb6-f829ef7c233e req-6bb16127-caf5-4c75-b6f9-1cf8f5335273 service nova] Creating event network-changed:3ccbca6d-373a-42a6-9d88-221bb0b77dd5 for instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c on hv-cinder-84779 Jun 27 15:30:18.404557 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-57226ea6-9a6e-4884-bbb6-f829ef7c233e req-6bb16127-caf5-4c75-b6f9-1cf8f5335273 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076782 Jun 27 15:30:18.408561 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 260/513] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:30:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:30:18.418276 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea83e581-608b-4791-a7a2-e9106397362f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:18.419128 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ea83e581-608b-4791-a7a2-e9106397362f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:18.427193 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea83e581-608b-4791-a7a2-e9106397362f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:18.427788 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea83e581-608b-4791-a7a2-e9106397362f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:18.428809 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea83e581-608b-4791-a7a2-e9106397362f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:18.429729 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea83e581-608b-4791-a7a2-e9106397362f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:18.433736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:18.683938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ea83e581-608b-4791-a7a2-e9106397362f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:18.695249 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ea83e581-608b-4791-a7a2-e9106397362f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1675 microversion: 2.1 time: 0.284442 Jun 27 15:30:18.696015 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 261/514] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:18 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1675 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:18.847868 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ab0683b5-4552-42a0-8ff1-91370565a41a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:18.861704 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ab0683b5-4552-42a0-8ff1-91370565a41a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1758 microversion: 2.1 time: 0.553488 Jun 27 15:30:18.863343 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 254/515] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:18 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1758 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:19.716039 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1830b576-5166-4174-9f5b-ef67bac117fd tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:19.717548 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1830b576-5166-4174-9f5b-ef67bac117fd tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:19.731698 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1830b576-5166-4174-9f5b-ef67bac117fd tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:19.732983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1830b576-5166-4174-9f5b-ef67bac117fd tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:19.734782 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1830b576-5166-4174-9f5b-ef67bac117fd tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:19.735802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1830b576-5166-4174-9f5b-ef67bac117fd tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:19.931354 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1830b576-5166-4174-9f5b-ef67bac117fd tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:19.940728 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1830b576-5166-4174-9f5b-ef67bac117fd tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1652 microversion: 2.1 time: 0.230379 Jun 27 15:30:19.941691 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 262/516] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:19 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1652 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:19.963603 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-abc605c1-03e9-4985-9f39-a8ad9179fcd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:19.971658 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abc605c1-03e9-4985-9f39-a8ad9179fcd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:19.972193 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abc605c1-03e9-4985-9f39-a8ad9179fcd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:19.998968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-abc605c1-03e9-4985-9f39-a8ad9179fcd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Going to try to start instance {{(pid=117977) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 15:30:20.049582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-abc605c1-03e9-4985-9f39-a8ad9179fcd8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/action" status: 202 len: 0 microversion: 2.1 time: 0.091292 Jun 27 15:30:20.050264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 255/517] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:30:19 2022] POST /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:30:20.059620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-df0ce332-754c-4116-a211-0dd32f72a404 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:20.060312 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-df0ce332-754c-4116-a211-0dd32f72a404 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:20.066997 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df0ce332-754c-4116-a211-0dd32f72a404 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:20.067480 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df0ce332-754c-4116-a211-0dd32f72a404 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:20.068499 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df0ce332-754c-4116-a211-0dd32f72a404 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:20.068941 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-df0ce332-754c-4116-a211-0dd32f72a404 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:20.246781 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-df0ce332-754c-4116-a211-0dd32f72a404 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:20.257433 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-df0ce332-754c-4116-a211-0dd32f72a404 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1661 microversion: 2.1 time: 0.202331 Jun 27 15:30:20.258462 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 263/518] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:20 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1661 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:21.276757 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2b295bc3-aef6-4497-a4ce-baee980f80de tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:21.277464 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2b295bc3-aef6-4497-a4ce-baee980f80de tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:21.286086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2b295bc3-aef6-4497-a4ce-baee980f80de tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:21.286795 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2b295bc3-aef6-4497-a4ce-baee980f80de tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:21.287948 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2b295bc3-aef6-4497-a4ce-baee980f80de tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:21.288732 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2b295bc3-aef6-4497-a4ce-baee980f80de tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:21.462622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2b295bc3-aef6-4497-a4ce-baee980f80de tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:21.473940 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2b295bc3-aef6-4497-a4ce-baee980f80de tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1661 microversion: 2.1 time: 0.201611 Jun 27 15:30:21.474622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 256/519] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:21 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1661 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:22.491982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-af67494b-a5d1-4795-b1cf-9bd6aec12720 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:22.492643 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-af67494b-a5d1-4795-b1cf-9bd6aec12720 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:22.501071 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af67494b-a5d1-4795-b1cf-9bd6aec12720 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:22.501576 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af67494b-a5d1-4795-b1cf-9bd6aec12720 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:22.502373 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af67494b-a5d1-4795-b1cf-9bd6aec12720 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:22.502822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af67494b-a5d1-4795-b1cf-9bd6aec12720 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:22.650602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-af67494b-a5d1-4795-b1cf-9bd6aec12720 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:22.659419 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-af67494b-a5d1-4795-b1cf-9bd6aec12720 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1665 microversion: 2.1 time: 0.171738 Jun 27 15:30:22.660012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 264/520] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:22 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1665 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:25.012524 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d85395ed-066c-48b0-afe3-f7dc3ab56bbf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "499ce291-7103-4456-b259-ed408755e005", "device": "/dev/sdb"}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:25.021137 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d85395ed-066c-48b0-afe3-f7dc3ab56bbf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:25.040532 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d85395ed-066c-48b0-afe3-f7dc3ab56bbf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:25.046612 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d85395ed-066c-48b0-afe3-f7dc3ab56bbf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:25.048705 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d85395ed-066c-48b0-afe3-f7dc3ab56bbf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:25.050287 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d85395ed-066c-48b0-afe3-f7dc3ab56bbf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:25.197502 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b2be494c-8114-4bd6-a84f-4c206362d1f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:25.198707 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b2be494c-8114-4bd6-a84f-4c206362d1f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:25.201577 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:25.209112 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2be494c-8114-4bd6-a84f-4c206362d1f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:25.210265 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2be494c-8114-4bd6-a84f-4c206362d1f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:25.211177 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2be494c-8114-4bd6-a84f-4c206362d1f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:25.211681 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b2be494c-8114-4bd6-a84f-4c206362d1f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:25.239800 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-b2be494c-8114-4bd6-a84f-4c206362d1f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lazy-loading 'flavor' on Instance uuid 6b96384b-617e-4ae6-989b-f16e60189883 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:30:25.435806 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b2be494c-8114-4bd6-a84f-4c206362d1f1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/action" status: 200 len: 32 microversion: 2.1 time: 0.242460 Jun 27 15:30:25.436654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 265/521] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:30:25 2022] POST /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/action => generated 32 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:30:25.448494 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6f7333eb-9338-4004-b58e-f07724ad16dc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:25.449182 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6f7333eb-9338-4004-b58e-f07724ad16dc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:25.456727 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f7333eb-9338-4004-b58e-f07724ad16dc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:25.457136 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f7333eb-9338-4004-b58e-f07724ad16dc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:25.457916 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f7333eb-9338-4004-b58e-f07724ad16dc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:25.458344 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6f7333eb-9338-4004-b58e-f07724ad16dc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:25.645896 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6f7333eb-9338-4004-b58e-f07724ad16dc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:25.657327 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6f7333eb-9338-4004-b58e-f07724ad16dc tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.212854 Jun 27 15:30:25.667478 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 266/522] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:25 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:25.777546 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d85395ed-066c-48b0-afe3-f7dc3ab56bbf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "POST /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.776082 Jun 27 15:30:25.780853 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 257/523] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:30:24 2022] POST /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801/os-volume_attachments => generated 194 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:30:26.675955 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-207800d3-517c-4a2a-9c66-64977c014f1e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:26.676555 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-207800d3-517c-4a2a-9c66-64977c014f1e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:26.683868 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-207800d3-517c-4a2a-9c66-64977c014f1e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:26.684341 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-207800d3-517c-4a2a-9c66-64977c014f1e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:26.685121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-207800d3-517c-4a2a-9c66-64977c014f1e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:26.685556 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-207800d3-517c-4a2a-9c66-64977c014f1e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:26.858322 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-207800d3-517c-4a2a-9c66-64977c014f1e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:26.867390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-207800d3-517c-4a2a-9c66-64977c014f1e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.195865 Jun 27 15:30:26.868488 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 267/524] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:26 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:27.886765 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b39c6e81-e03b-479e-8679-703cf340047a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:27.887499 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b39c6e81-e03b-479e-8679-703cf340047a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:27.894701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b39c6e81-e03b-479e-8679-703cf340047a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:27.895138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b39c6e81-e03b-479e-8679-703cf340047a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:27.895906 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b39c6e81-e03b-479e-8679-703cf340047a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:27.896355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b39c6e81-e03b-479e-8679-703cf340047a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:28.037027 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b39c6e81-e03b-479e-8679-703cf340047a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:28.045272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b39c6e81-e03b-479e-8679-703cf340047a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.163415 Jun 27 15:30:28.045837 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 258/525] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:27 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:29.064803 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e6d9d44e-f45c-4d40-a4b5-e62526035c45 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:29.065737 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e6d9d44e-f45c-4d40-a4b5-e62526035c45 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:29.072772 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e6d9d44e-f45c-4d40-a4b5-e62526035c45 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:29.073220 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e6d9d44e-f45c-4d40-a4b5-e62526035c45 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:29.073998 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e6d9d44e-f45c-4d40-a4b5-e62526035c45 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:29.074426 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e6d9d44e-f45c-4d40-a4b5-e62526035c45 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:29.228872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e6d9d44e-f45c-4d40-a4b5-e62526035c45 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:29.239230 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e6d9d44e-f45c-4d40-a4b5-e62526035c45 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.178916 Jun 27 15:30:29.239774 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 268/526] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:29 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:30.258351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3f7c399e-8abb-4740-812f-d6f880fb1719 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:30.259110 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3f7c399e-8abb-4740-812f-d6f880fb1719 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:30.262404 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=74 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:30.271097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f7c399e-8abb-4740-812f-d6f880fb1719 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:30.271844 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f7c399e-8abb-4740-812f-d6f880fb1719 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:30.273160 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f7c399e-8abb-4740-812f-d6f880fb1719 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:30.273847 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f7c399e-8abb-4740-812f-d6f880fb1719 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:30.432175 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3f7c399e-8abb-4740-812f-d6f880fb1719 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:30.434895 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:30.442356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3f7c399e-8abb-4740-812f-d6f880fb1719 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.188841 Jun 27 15:30:30.442951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 259/527] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:30 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:31.460556 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bb128b47-dd80-480d-a940-f426136d15c8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:31.461387 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bb128b47-dd80-480d-a940-f426136d15c8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:31.468060 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb128b47-dd80-480d-a940-f426136d15c8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:31.468578 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb128b47-dd80-480d-a940-f426136d15c8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:31.469366 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb128b47-dd80-480d-a940-f426136d15c8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:31.469800 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb128b47-dd80-480d-a940-f426136d15c8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:31.614006 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bb128b47-dd80-480d-a940-f426136d15c8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:31.632838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bb128b47-dd80-480d-a940-f426136d15c8 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.176624 Jun 27 15:30:31.633458 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 269/528] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:31 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:32.650909 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f500bef7-ad14-43ec-a5f6-f95ef167b2eb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:32.651524 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f500bef7-ad14-43ec-a5f6-f95ef167b2eb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:32.659910 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f500bef7-ad14-43ec-a5f6-f95ef167b2eb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:32.660386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f500bef7-ad14-43ec-a5f6-f95ef167b2eb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:32.661170 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f500bef7-ad14-43ec-a5f6-f95ef167b2eb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:32.661672 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f500bef7-ad14-43ec-a5f6-f95ef167b2eb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:32.807219 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f500bef7-ad14-43ec-a5f6-f95ef167b2eb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:32.816559 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f500bef7-ad14-43ec-a5f6-f95ef167b2eb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.169471 Jun 27 15:30:32.817255 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 260/529] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:32 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:33.834557 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-33c0da83-0cba-4ce7-ba82-a8a1ad5c7982 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:33.835278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-33c0da83-0cba-4ce7-ba82-a8a1ad5c7982 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:33.842528 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33c0da83-0cba-4ce7-ba82-a8a1ad5c7982 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:33.842984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33c0da83-0cba-4ce7-ba82-a8a1ad5c7982 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:33.843818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33c0da83-0cba-4ce7-ba82-a8a1ad5c7982 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:33.844254 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-33c0da83-0cba-4ce7-ba82-a8a1ad5c7982 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:34.009176 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-33c0da83-0cba-4ce7-ba82-a8a1ad5c7982 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:34.018130 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-33c0da83-0cba-4ce7-ba82-a8a1ad5c7982 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.187703 Jun 27 15:30:34.018832 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 270/530] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:33 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:35.037920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-768a4048-c500-40b5-906e-4d6ce470e19d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:35.038688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-768a4048-c500-40b5-906e-4d6ce470e19d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:35.046379 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-768a4048-c500-40b5-906e-4d6ce470e19d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:35.046806 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-768a4048-c500-40b5-906e-4d6ce470e19d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:35.047649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-768a4048-c500-40b5-906e-4d6ce470e19d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:35.048092 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-768a4048-c500-40b5-906e-4d6ce470e19d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:35.191082 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-768a4048-c500-40b5-906e-4d6ce470e19d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:35.204175 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-768a4048-c500-40b5-906e-4d6ce470e19d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.172062 Jun 27 15:30:35.205215 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 261/531] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:35 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:36.232778 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f5446fae-c10a-4711-8692-d0a42e02756d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:36.233653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f5446fae-c10a-4711-8692-d0a42e02756d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:36.241478 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f5446fae-c10a-4711-8692-d0a42e02756d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:36.241954 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f5446fae-c10a-4711-8692-d0a42e02756d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:36.242734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f5446fae-c10a-4711-8692-d0a42e02756d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:36.243166 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f5446fae-c10a-4711-8692-d0a42e02756d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:36.386579 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f5446fae-c10a-4711-8692-d0a42e02756d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:36.394742 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f5446fae-c10a-4711-8692-d0a42e02756d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.167018 Jun 27 15:30:36.395430 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 271/532] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:36 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:37.416726 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-18ddbadc-e907-4b3b-83e0-ead0490de040 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:37.417287 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-18ddbadc-e907-4b3b-83e0-ead0490de040 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:37.424429 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18ddbadc-e907-4b3b-83e0-ead0490de040 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:37.424878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18ddbadc-e907-4b3b-83e0-ead0490de040 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:37.425650 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18ddbadc-e907-4b3b-83e0-ead0490de040 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:37.426114 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-18ddbadc-e907-4b3b-83e0-ead0490de040 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:37.577647 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-18ddbadc-e907-4b3b-83e0-ead0490de040 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:37.588356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-18ddbadc-e907-4b3b-83e0-ead0490de040 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.179306 Jun 27 15:30:37.589089 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 262/533] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:37 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:38.615413 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-364f6c9d-a024-4e22-803a-fb8f1234ef69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:38.616331 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-364f6c9d-a024-4e22-803a-fb8f1234ef69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:38.623431 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-364f6c9d-a024-4e22-803a-fb8f1234ef69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:38.623874 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-364f6c9d-a024-4e22-803a-fb8f1234ef69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:38.624694 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-364f6c9d-a024-4e22-803a-fb8f1234ef69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:38.625138 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-364f6c9d-a024-4e22-803a-fb8f1234ef69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:38.777569 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-364f6c9d-a024-4e22-803a-fb8f1234ef69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:38.786668 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-364f6c9d-a024-4e22-803a-fb8f1234ef69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.175104 Jun 27 15:30:38.787349 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 272/534] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:38 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:39.805551 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-57ef50c1-2818-4c69-ba66-5ef027d5c5fe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:39.806206 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-57ef50c1-2818-4c69-ba66-5ef027d5c5fe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:39.813388 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-57ef50c1-2818-4c69-ba66-5ef027d5c5fe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:39.813844 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-57ef50c1-2818-4c69-ba66-5ef027d5c5fe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:39.814607 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-57ef50c1-2818-4c69-ba66-5ef027d5c5fe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:39.815036 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-57ef50c1-2818-4c69-ba66-5ef027d5c5fe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:39.962699 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-57ef50c1-2818-4c69-ba66-5ef027d5c5fe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:39.973386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-57ef50c1-2818-4c69-ba66-5ef027d5c5fe tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.171782 Jun 27 15:30:39.973981 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 263/535] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:39 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:40.993500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3a2a9c65-0fd3-46e3-8a94-c3c7277caf1a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:40.994329 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3a2a9c65-0fd3-46e3-8a94-c3c7277caf1a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:41.002013 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c65-0fd3-46e3-8a94-c3c7277caf1a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:41.002463 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c65-0fd3-46e3-8a94-c3c7277caf1a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:41.003944 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c65-0fd3-46e3-8a94-c3c7277caf1a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:41.004449 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3a2a9c65-0fd3-46e3-8a94-c3c7277caf1a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:41.163349 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3a2a9c65-0fd3-46e3-8a94-c3c7277caf1a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:41.171658 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3a2a9c65-0fd3-46e3-8a94-c3c7277caf1a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.183967 Jun 27 15:30:41.172230 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 273/536] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:40 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:42.193985 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f527da37-0969-4f4b-a6f2-e0e32ad60501 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:42.196587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f527da37-0969-4f4b-a6f2-e0e32ad60501 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:42.213162 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f527da37-0969-4f4b-a6f2-e0e32ad60501 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:42.214240 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f527da37-0969-4f4b-a6f2-e0e32ad60501 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:42.216255 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f527da37-0969-4f4b-a6f2-e0e32ad60501 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:42.217112 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f527da37-0969-4f4b-a6f2-e0e32ad60501 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:42.395576 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f527da37-0969-4f4b-a6f2-e0e32ad60501 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:42.411384 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f527da37-0969-4f4b-a6f2-e0e32ad60501 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.223680 Jun 27 15:30:42.412429 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 264/537] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:42 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:43.435743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-22a03d57-bf96-4947-963e-103169f4248b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:43.437456 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-22a03d57-bf96-4947-963e-103169f4248b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:43.448009 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22a03d57-bf96-4947-963e-103169f4248b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:43.448499 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22a03d57-bf96-4947-963e-103169f4248b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:43.449302 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22a03d57-bf96-4947-963e-103169f4248b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:43.449765 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22a03d57-bf96-4947-963e-103169f4248b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:43.610762 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-22a03d57-bf96-4947-963e-103169f4248b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:43.621302 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-22a03d57-bf96-4947-963e-103169f4248b tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.190513 Jun 27 15:30:43.621859 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 274/538] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:43 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:44.644279 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2d0c3bb7-ba3c-40c0-b5a2-7a98be8611a7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:44.644889 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2d0c3bb7-ba3c-40c0-b5a2-7a98be8611a7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:44.651762 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2d0c3bb7-ba3c-40c0-b5a2-7a98be8611a7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:44.652217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2d0c3bb7-ba3c-40c0-b5a2-7a98be8611a7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:44.653043 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2d0c3bb7-ba3c-40c0-b5a2-7a98be8611a7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:44.653837 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2d0c3bb7-ba3c-40c0-b5a2-7a98be8611a7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:44.813273 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2d0c3bb7-ba3c-40c0-b5a2-7a98be8611a7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:44.826308 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2d0c3bb7-ba3c-40c0-b5a2-7a98be8611a7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.185834 Jun 27 15:30:44.827182 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 265/539] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:44 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:45.849177 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-90b8d17e-5d4e-42f3-b4cf-51cf8181a564 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:45.849755 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-90b8d17e-5d4e-42f3-b4cf-51cf8181a564 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:45.857507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-90b8d17e-5d4e-42f3-b4cf-51cf8181a564 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:45.858313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-90b8d17e-5d4e-42f3-b4cf-51cf8181a564 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:45.859054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-90b8d17e-5d4e-42f3-b4cf-51cf8181a564 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:45.859821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-90b8d17e-5d4e-42f3-b4cf-51cf8181a564 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:46.008479 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-90b8d17e-5d4e-42f3-b4cf-51cf8181a564 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:46.012587 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:46.022365 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-90b8d17e-5d4e-42f3-b4cf-51cf8181a564 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.181871 Jun 27 15:30:46.023028 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 275/540] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:45 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:47.044245 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-69019602-5d0c-412d-a0cc-99a99da16f69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:47.045098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-69019602-5d0c-412d-a0cc-99a99da16f69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:47.052137 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-69019602-5d0c-412d-a0cc-99a99da16f69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:47.052613 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-69019602-5d0c-412d-a0cc-99a99da16f69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:47.053394 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-69019602-5d0c-412d-a0cc-99a99da16f69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:47.053826 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-69019602-5d0c-412d-a0cc-99a99da16f69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:47.202144 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-69019602-5d0c-412d-a0cc-99a99da16f69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:47.210705 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-69019602-5d0c-412d-a0cc-99a99da16f69 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.173056 Jun 27 15:30:47.211285 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 266/541] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:47 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:48.229937 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-753d939f-1096-4b34-8346-2dcea6eacaf6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:48.230437 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-753d939f-1096-4b34-8346-2dcea6eacaf6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:48.237888 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-753d939f-1096-4b34-8346-2dcea6eacaf6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:48.238717 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-753d939f-1096-4b34-8346-2dcea6eacaf6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:48.239568 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-753d939f-1096-4b34-8346-2dcea6eacaf6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:48.240060 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-753d939f-1096-4b34-8346-2dcea6eacaf6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:48.373940 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-753d939f-1096-4b34-8346-2dcea6eacaf6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:48.382446 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-753d939f-1096-4b34-8346-2dcea6eacaf6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.157425 Jun 27 15:30:48.384697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 276/542] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:48 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:49.399897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f7ce2708-58bb-4873-afea-3fed97482502 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:49.400599 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f7ce2708-58bb-4873-afea-3fed97482502 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:49.406996 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f7ce2708-58bb-4873-afea-3fed97482502 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:49.407438 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f7ce2708-58bb-4873-afea-3fed97482502 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:49.408210 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f7ce2708-58bb-4873-afea-3fed97482502 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:49.408669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f7ce2708-58bb-4873-afea-3fed97482502 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:49.545326 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f7ce2708-58bb-4873-afea-3fed97482502 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:49.553629 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f7ce2708-58bb-4873-afea-3fed97482502 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.157782 Jun 27 15:30:49.554235 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 267/543] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:49 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:49.744796 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ab80fe92-7498-4a73-b870-eaa699f99a33 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:49.745308 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ab80fe92-7498-4a73-b870-eaa699f99a33 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:49.752598 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab80fe92-7498-4a73-b870-eaa699f99a33 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:49.753049 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab80fe92-7498-4a73-b870-eaa699f99a33 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:49.753816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab80fe92-7498-4a73-b870-eaa699f99a33 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:49.754252 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ab80fe92-7498-4a73-b870-eaa699f99a33 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:49.885331 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-ab80fe92-7498-4a73-b870-eaa699f99a33 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lazy-loading 'services' on Instance uuid 5e2cf58f-7730-4d52-8712-24fcfbf19801 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:30:50.019011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ab80fe92-7498-4a73-b870-eaa699f99a33 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801/os-volume_attachments/499ce291-7103-4456-b259-ed408755e005" status: 202 len: 0 microversion: 2.1 time: 0.278121 Jun 27 15:30:50.019909 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 277/544] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:30:49 2022] DELETE /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801/os-volume_attachments/499ce291-7103-4456-b259-ed408755e005 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:30:50.571532 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-645d1398-273b-4f85-aa90-87819ba65d07 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:50.572242 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-645d1398-273b-4f85-aa90-87819ba65d07 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:50.583804 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-645d1398-273b-4f85-aa90-87819ba65d07 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:50.584877 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-645d1398-273b-4f85-aa90-87819ba65d07 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:50.586609 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-645d1398-273b-4f85-aa90-87819ba65d07 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:50.587640 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-645d1398-273b-4f85-aa90-87819ba65d07 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:50.790483 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-645d1398-273b-4f85-aa90-87819ba65d07 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:50.799613 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-645d1398-273b-4f85-aa90-87819ba65d07 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1734 microversion: 2.1 time: 0.231973 Jun 27 15:30:50.800432 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 268/545] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:50 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1734 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:51.819794 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-447be788-07be-478b-b2af-4ebc84975de2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:51.820552 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-447be788-07be-478b-b2af-4ebc84975de2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:51.827873 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-447be788-07be-478b-b2af-4ebc84975de2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:51.828354 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-447be788-07be-478b-b2af-4ebc84975de2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:51.829158 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-447be788-07be-478b-b2af-4ebc84975de2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:51.829593 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-447be788-07be-478b-b2af-4ebc84975de2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:51.976525 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-447be788-07be-478b-b2af-4ebc84975de2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:51.984807 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-447be788-07be-478b-b2af-4ebc84975de2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1714 microversion: 2.1 time: 0.170331 Jun 27 15:30:51.985418 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 278/546] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:51 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1714 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:52.103033 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8733f988-a447-45df-a9b1-8afa86929f8e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:52.103688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8733f988-a447-45df-a9b1-8afa86929f8e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:52.110785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8733f988-a447-45df-a9b1-8afa86929f8e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:52.111243 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8733f988-a447-45df-a9b1-8afa86929f8e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:52.112136 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8733f988-a447-45df-a9b1-8afa86929f8e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:52.112525 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8733f988-a447-45df-a9b1-8afa86929f8e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:52.227568 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bb8b531b-1cd9-44af-9146-9f7657271a21 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:52.228062 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bb8b531b-1cd9-44af-9146-9f7657271a21 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:52.232078 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-8733f988-a447-45df-a9b1-8afa86929f8e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] HTTP exception thrown: Cannot 'detach_volume' instance 6b96384b-617e-4ae6-989b-f16e60189883 while it is in vm_state rescued Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8733f988-a447-45df-a9b1-8afa86929f8e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Request method failure captured: Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: DELETE /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments/66ade38e-6d5a-444c-8c26-288eb44208a3 HTTP/1.1 Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwoSnYhPWU8-WWSH7wGBafQXIjG8xq98RxBC5ln0qY8NkV2iLRGT08tr0ASJ32aKDac2AetAJt5KEH-MB45B6tNlCKvzjpp2VxDDEmGGD9f2DWMJUawGMuLpCecS5Sr5leKkWGj1HDRn5lcOcvOa-_F1S9KTpDSmAaKp-xUVFJjM6g Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 2832173587a6494eb7f73b3ca0a09a0f Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:30:52.234141 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2832173587a6494eb7f73b3ca0a09a0f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 2832173587a6494eb7f73b3ca0a09a0f Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-ServerRescueNegativeTestJSON-640731549-project Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: effe0200dc584f11923e83ed240138ff Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-ServerRescueNegativeTestJSON-640731549-project Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:30:52.235433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Cannot 'detach_volume' instance 6b96384b-617e-4ae6-989b-f16e60189883 while it is in vm_state rescued Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'server_id': '6b96384b-617e-4ae6-989b-f16e60189883', 'id': '66ade38e-6d5a-444c-8c26-288eb44208a3'} Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b96384b-617e-4ae6-989b-f16e60189883 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:30:52.236106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6b96384b-617e-4ae6-989b-f16e60189883 while it is in vm_state rescued Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6b96384b-617e-4ae6-989b-f16e60189883 while it is in vm_state rescued Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:30:52.237408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8733f988-a447-45df-a9b1-8afa86929f8e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Returning 409 to user: Cannot 'detach_volume' instance 6b96384b-617e-4ae6-989b-f16e60189883 while it is in vm_state rescued {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:30:52.238362 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb8b531b-1cd9-44af-9146-9f7657271a21 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:52.238362 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb8b531b-1cd9-44af-9146-9f7657271a21 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:52.238519 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8733f988-a447-45df-a9b1-8afa86929f8e tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments/66ade38e-6d5a-444c-8c26-288eb44208a3" status: 409 len: 152 microversion: 2.1 time: 0.136891 Jun 27 15:30:52.238603 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb8b531b-1cd9-44af-9146-9f7657271a21 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:52.238603 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bb8b531b-1cd9-44af-9146-9f7657271a21 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:52.239479 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 269/547] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:30:52 2022] DELETE /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments/66ade38e-6d5a-444c-8c26-288eb44208a3 => generated 152 bytes in 142 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 15:30:52.244927 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-af991e2b-837d-4579-ad03-6dcfc40c9ef7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:52.246086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-af991e2b-837d-4579-ad03-6dcfc40c9ef7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:52.252298 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-af991e2b-837d-4579-ad03-6dcfc40c9ef7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:52.252771 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-af991e2b-837d-4579-ad03-6dcfc40c9ef7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:52.253544 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-af991e2b-837d-4579-ad03-6dcfc40c9ef7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:52.253970 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-af991e2b-837d-4579-ad03-6dcfc40c9ef7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:52.272710 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bb8b531b-1cd9-44af-9146-9f7657271a21 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:30:52.330182 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-af991e2b-837d-4579-ad03-6dcfc40c9ef7 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "POST /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/action" status: 202 len: 0 microversion: 2.1 time: 0.088969 Jun 27 15:30:52.331246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 270/548] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:30:52 2022] POST /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:30:52.341736 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9a1c4de0-79f6-4816-9d94-0e6b34181d79 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:52.342892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9a1c4de0-79f6-4816-9d94-0e6b34181d79 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:52.351648 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9a1c4de0-79f6-4816-9d94-0e6b34181d79 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:52.352964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9a1c4de0-79f6-4816-9d94-0e6b34181d79 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:52.353895 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9a1c4de0-79f6-4816-9d94-0e6b34181d79 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:52.354593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9a1c4de0-79f6-4816-9d94-0e6b34181d79 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:52.366710 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bb8b531b-1cd9-44af-9146-9f7657271a21 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "DELETE /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 204 len: 0 microversion: 2.1 time: 0.142599 Jun 27 15:30:52.367775 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 279/549] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:30:52 2022] DELETE /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:30:52.379120 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e5f7aab1-10dc-41f1-b9c6-a0b76c605034 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:52.379827 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e5f7aab1-10dc-41f1-b9c6-a0b76c605034 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:52.386389 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5f7aab1-10dc-41f1-b9c6-a0b76c605034 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:52.386837 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5f7aab1-10dc-41f1-b9c6-a0b76c605034 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:52.387620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5f7aab1-10dc-41f1-b9c6-a0b76c605034 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:52.388137 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e5f7aab1-10dc-41f1-b9c6-a0b76c605034 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:52.516761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9a1c4de0-79f6-4816-9d94-0e6b34181d79 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:52.525027 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9a1c4de0-79f6-4816-9d94-0e6b34181d79 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1722 microversion: 2.1 time: 0.189180 Jun 27 15:30:52.525680 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 271/550] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:52 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:52.533328 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e5f7aab1-10dc-41f1-b9c6-a0b76c605034 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:52.542215 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e5f7aab1-10dc-41f1-b9c6-a0b76c605034 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1514 microversion: 2.1 time: 0.167134 Jun 27 15:30:52.542820 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 280/551] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:52 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:53.543469 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-666f4b47-fe41-43c0-9904-6f4defbefec5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:53.544087 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-666f4b47-fe41-43c0-9904-6f4defbefec5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:53.551384 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-666f4b47-fe41-43c0-9904-6f4defbefec5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:53.551910 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-666f4b47-fe41-43c0-9904-6f4defbefec5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:53.552776 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-666f4b47-fe41-43c0-9904-6f4defbefec5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:53.553276 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-666f4b47-fe41-43c0-9904-6f4defbefec5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:53.561061 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-25843a8a-178e-462c-8c7c-9019d6dc8963 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:53.562317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-25843a8a-178e-462c-8c7c-9019d6dc8963 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:53.570944 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25843a8a-178e-462c-8c7c-9019d6dc8963 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:53.571395 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25843a8a-178e-462c-8c7c-9019d6dc8963 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:53.572222 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25843a8a-178e-462c-8c7c-9019d6dc8963 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:53.572677 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-25843a8a-178e-462c-8c7c-9019d6dc8963 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:53.706480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-666f4b47-fe41-43c0-9904-6f4defbefec5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:53.715841 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-666f4b47-fe41-43c0-9904-6f4defbefec5 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1722 microversion: 2.1 time: 0.176387 Jun 27 15:30:53.716737 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 272/552] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:53 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:53.720546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-25843a8a-178e-462c-8c7c-9019d6dc8963 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:53.729099 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-25843a8a-178e-462c-8c7c-9019d6dc8963 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1514 microversion: 2.1 time: 0.172597 Jun 27 15:30:53.729770 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 281/553] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:53 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:54.734324 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-dc7709fd-5c4a-4734-acd2-f7aea959ea22 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:54.734324 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-dc7709fd-5c4a-4734-acd2-f7aea959ea22 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:54.741849 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dc7709fd-5c4a-4734-acd2-f7aea959ea22 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:54.742344 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dc7709fd-5c4a-4734-acd2-f7aea959ea22 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:54.743146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dc7709fd-5c4a-4734-acd2-f7aea959ea22 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:54.743561 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dc7709fd-5c4a-4734-acd2-f7aea959ea22 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:54.748400 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4227f39f-e08c-4d17-8857-93509809fe59 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:54.749004 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4227f39f-e08c-4d17-8857-93509809fe59 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:54.756404 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4227f39f-e08c-4d17-8857-93509809fe59 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:54.757183 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4227f39f-e08c-4d17-8857-93509809fe59 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:54.758142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4227f39f-e08c-4d17-8857-93509809fe59 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:54.758589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4227f39f-e08c-4d17-8857-93509809fe59 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:54.925264 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4227f39f-e08c-4d17-8857-93509809fe59 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:54.933537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4227f39f-e08c-4d17-8857-93509809fe59 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1514 microversion: 2.1 time: 0.190359 Jun 27 15:30:54.934131 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 282/554] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:54 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1514 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:55.013651 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-dc7709fd-5c4a-4734-acd2-f7aea959ea22 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:55.023756 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-dc7709fd-5c4a-4734-acd2-f7aea959ea22 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1722 microversion: 2.1 time: 0.294355 Jun 27 15:30:55.024488 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 273/555] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:54 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:55.203268 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-80a1a04f-61d0-4b5a-8abd-d846a89a3997 req-849e803b-4f8b-470f-89b8-6ebb1a01af63 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e2cf58f-7730-4d52-8712-24fcfbf19801", "name": "network-vif-deleted", "tag": "684b638a-b884-40ba-bebd-043ddafe9556"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:55.212382 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-80a1a04f-61d0-4b5a-8abd-d846a89a3997 req-849e803b-4f8b-470f-89b8-6ebb1a01af63 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:55.212821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-80a1a04f-61d0-4b5a-8abd-d846a89a3997 req-849e803b-4f8b-470f-89b8-6ebb1a01af63 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:55.227664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-80a1a04f-61d0-4b5a-8abd-d846a89a3997 req-849e803b-4f8b-470f-89b8-6ebb1a01af63 service nova] Creating event network-vif-deleted:684b638a-b884-40ba-bebd-043ddafe9556 for instance 5e2cf58f-7730-4d52-8712-24fcfbf19801 on hv-cinder-84779 Jun 27 15:30:55.233271 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-80a1a04f-61d0-4b5a-8abd-d846a89a3997 req-849e803b-4f8b-470f-89b8-6ebb1a01af63 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034074 Jun 27 15:30:55.233868 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 283/556] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:30:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:30:55.959659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4486e415-1596-4d96-99dc-7db820e36849 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:55.960293 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4486e415-1596-4d96-99dc-7db820e36849 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:55.970017 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4486e415-1596-4d96-99dc-7db820e36849 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:55.970616 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4486e415-1596-4d96-99dc-7db820e36849 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:55.971763 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4486e415-1596-4d96-99dc-7db820e36849 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:55.972374 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4486e415-1596-4d96-99dc-7db820e36849 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:56.042773 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5c4986c3-03c9-4773-a408-f3832f24ade1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:56.043851 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5c4986c3-03c9-4773-a408-f3832f24ade1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:56.045759 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:56.049187 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4486e415-1596-4d96-99dc-7db820e36849 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:56.051684 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c4986c3-03c9-4773-a408-f3832f24ade1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:56.052119 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c4986c3-03c9-4773-a408-f3832f24ade1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:56.052972 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c4986c3-03c9-4773-a408-f3832f24ade1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:56.053428 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5c4986c3-03c9-4773-a408-f3832f24ade1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:56.063897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4486e415-1596-4d96-99dc-7db820e36849 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1472 microversion: 2.1 time: 0.108874 Jun 27 15:30:56.064968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 274/557] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:55 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1472 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:56.198167 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5c4986c3-03c9-4773-a408-f3832f24ade1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:56.207616 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5c4986c3-03c9-4773-a408-f3832f24ade1 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1722 microversion: 2.1 time: 0.169668 Jun 27 15:30:56.208267 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 284/558] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:56 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:30:57.087593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:57.088187 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:57.096101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:57.096580 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:57.097424 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:57.097855 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:57.115540 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:30:57.135578 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:57.136063 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:57.136556 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lazy-loading 'fault' on Instance uuid 5e2cf58f-7730-4d52-8712-24fcfbf19801 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:30:57.185348 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:57.195720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b02a4b9a-1f9f-4a1c-8774-ca45cad2a8c8 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 200 len: 1308 microversion: 2.1 time: 0.112103 Jun 27 15:30:57.196378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 275/559] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:57 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:57.227545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dd68f325-a7f6-45fd-ba01-ff2ecc086e0f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:57.228420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dd68f325-a7f6-45fd-ba01-ff2ecc086e0f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:57.235542 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd68f325-a7f6-45fd-ba01-ff2ecc086e0f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:57.235996 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd68f325-a7f6-45fd-ba01-ff2ecc086e0f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:57.236803 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd68f325-a7f6-45fd-ba01-ff2ecc086e0f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:57.237427 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd68f325-a7f6-45fd-ba01-ff2ecc086e0f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:57.386198 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dd68f325-a7f6-45fd-ba01-ff2ecc086e0f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:57.399693 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dd68f325-a7f6-45fd-ba01-ff2ecc086e0f tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1722 microversion: 2.1 time: 0.175932 Jun 27 15:30:57.409888 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 285/560] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:57 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1722 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:58.213767 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7d132765-45cf-4f51-a326-c750b43f4b93 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:58.214450 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7d132765-45cf-4f51-a326-c750b43f4b93 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: 5e2cf58f-7730-4d52-8712-24fcfbf19801] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:58.221597 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7d132765-45cf-4f51-a326-c750b43f4b93 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:58.222044 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7d132765-45cf-4f51-a326-c750b43f4b93 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:58.222845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7d132765-45cf-4f51-a326-c750b43f4b93 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:58.223278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7d132765-45cf-4f51-a326-c750b43f4b93 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:58.237547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-7d132765-45cf-4f51-a326-c750b43f4b93 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] HTTP exception thrown: Instance 5e2cf58f-7730-4d52-8712-24fcfbf19801 could not be found. Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7d132765-45cf-4f51-a326-c750b43f4b93 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Request method failure captured: Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 HTTP/1.1 Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiuczgyU0UXRSz9iacx9Cq_LiLKiZrCgzzPkjiS92qvy3s_R437MKFZ-J6qfZnaRnDyojwt--F00znvlt06M-mM1G0bAXVyUUhJ5oCNfMKxVCMGZ36rCXs5EWPU13AvDVmPDpdv2JdL8WKB4G_oUSd7NJVKXmoK1pQuLVE2rWg32lRRJo Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: fe9612aa8fdd4be0a4a3ecfaefb96fca Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1686479676 Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:30:58.239179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fe9612aa8fdd4be0a4a3ecfaefb96fca", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fe9612aa8fdd4be0a4a3ecfaefb96fca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe9612aa8fdd4be0a4a3ecfaefb96fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe9612aa8fdd4be0a4a3ecfaefb96fca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesSnapshotTestJSON-1686479676 Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: fe9612aa8fdd4be0a4a3ecfaefb96fca Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1686479676 Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesSnapshotTestJSON-1686479676-project Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 4e1f142fbc2a4159b5ad3a672170db10 Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesSnapshotTestJSON-1686479676-project Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 5e2cf58f-7730-4d52-8712-24fcfbf19801 could not be found. Jun 27 15:30:58.240677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '5e2cf58f-7730-4d52-8712-24fcfbf19801'} Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e2cf58f-7730-4d52-8712-24fcfbf19801 could not be found. Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:30:58.241621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e2cf58f-7730-4d52-8712-24fcfbf19801 could not be found. Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e2cf58f-7730-4d52-8712-24fcfbf19801 could not be found. Jun 27 15:30:58.242978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:30:58.244259 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7d132765-45cf-4f51-a326-c750b43f4b93 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Returning 404 to user: Instance 5e2cf58f-7730-4d52-8712-24fcfbf19801 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:30:58.244259 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7d132765-45cf-4f51-a326-c750b43f4b93 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801" status: 404 len: 111 microversion: 2.1 time: 0.030892 Jun 27 15:30:58.244259 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 276/561] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:58 2022] GET /compute/v2.1/servers/5e2cf58f-7730-4d52-8712-24fcfbf19801 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:30:58.419761 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f85d92eb-0635-4b7a-942b-f6f99f259121 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:58.420400 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f85d92eb-0635-4b7a-942b-f6f99f259121 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:58.427588 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f85d92eb-0635-4b7a-942b-f6f99f259121 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:58.428029 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f85d92eb-0635-4b7a-942b-f6f99f259121 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:58.429340 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f85d92eb-0635-4b7a-942b-f6f99f259121 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:58.429657 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f85d92eb-0635-4b7a-942b-f6f99f259121 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:58.580833 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f85d92eb-0635-4b7a-942b-f6f99f259121 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:30:58.589570 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f85d92eb-0635-4b7a-942b-f6f99f259121 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1728 microversion: 2.1 time: 0.175673 Jun 27 15:30:58.590464 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 286/562] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:30:58 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1728 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:30:58.606821 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-73798f65-f544-461f-919d-2e56d0e29084 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:30:58.607290 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-73798f65-f544-461f-919d-2e56d0e29084 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:30:58.613621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73798f65-f544-461f-919d-2e56d0e29084 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:58.614053 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73798f65-f544-461f-919d-2e56d0e29084 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:58.615153 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73798f65-f544-461f-919d-2e56d0e29084 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:58.615286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73798f65-f544-461f-919d-2e56d0e29084 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:58.698929 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-73798f65-f544-461f-919d-2e56d0e29084 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095767 Jun 27 15:30:58.699868 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 277/563] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jun 27 15:30:58 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:30:59.682782 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-a75ff2ec-789f-4ccc-85bd-5e457bad3cb0 req-e01da4a3-1c0d-45c6-9aed-e48eea8c4b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b96384b-617e-4ae6-989b-f16e60189883", "tag": "44036d57-a43c-4cb8-b4e7-dad2d8ab154a"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:30:59.701302 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a75ff2ec-789f-4ccc-85bd-5e457bad3cb0 req-e01da4a3-1c0d-45c6-9aed-e48eea8c4b5f service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:30:59.702148 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a75ff2ec-789f-4ccc-85bd-5e457bad3cb0 req-e01da4a3-1c0d-45c6-9aed-e48eea8c4b5f service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:30:59.723232 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-a75ff2ec-789f-4ccc-85bd-5e457bad3cb0 req-e01da4a3-1c0d-45c6-9aed-e48eea8c4b5f service nova] Creating event network-changed:44036d57-a43c-4cb8-b4e7-dad2d8ab154a for instance 6b96384b-617e-4ae6-989b-f16e60189883 on hv-cinder-84779 Jun 27 15:30:59.728225 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-a75ff2ec-789f-4ccc-85bd-5e457bad3cb0 req-e01da4a3-1c0d-45c6-9aed-e48eea8c4b5f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052728 Jun 27 15:30:59.728871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 287/564] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:30:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:01.771434 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-3bcb1f5c-4994-4648-b668-5e03ce0e813d req-44ae6767-932d-4324-8318-642f99014186 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b96384b-617e-4ae6-989b-f16e60189883", "tag": "44036d57-a43c-4cb8-b4e7-dad2d8ab154a"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:01.776374 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=40 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:01.785162 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-3bcb1f5c-4994-4648-b668-5e03ce0e813d req-44ae6767-932d-4324-8318-642f99014186 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:01.785915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-3bcb1f5c-4994-4648-b668-5e03ce0e813d req-44ae6767-932d-4324-8318-642f99014186 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:01.802042 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-3bcb1f5c-4994-4648-b668-5e03ce0e813d req-44ae6767-932d-4324-8318-642f99014186 service nova] Creating event network-changed:44036d57-a43c-4cb8-b4e7-dad2d8ab154a for instance 6b96384b-617e-4ae6-989b-f16e60189883 on hv-cinder-84779 Jun 27 15:31:01.807782 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-3bcb1f5c-4994-4648-b668-5e03ce0e813d req-44ae6767-932d-4324-8318-642f99014186 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041971 Jun 27 15:31:01.808800 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 278/565] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:04.619646 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7a370f25-a2c3-47dc-aeb0-e914ed1a14e6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:04.621199 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7a370f25-a2c3-47dc-aeb0-e914ed1a14e6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:04.627909 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a370f25-a2c3-47dc-aeb0-e914ed1a14e6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:04.628345 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a370f25-a2c3-47dc-aeb0-e914ed1a14e6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:04.629321 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a370f25-a2c3-47dc-aeb0-e914ed1a14e6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:04.629750 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7a370f25-a2c3-47dc-aeb0-e914ed1a14e6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:04.709216 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7a370f25-a2c3-47dc-aeb0-e914ed1a14e6 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "POST /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/action" status: 202 len: 0 microversion: 2.1 time: 0.094503 Jun 27 15:31:04.710067 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 288/566] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:31:04 2022] POST /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:31:04.720696 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5b6282e5-e4e3-46e0-bc05-fc34d69c1207 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:04.721579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5b6282e5-e4e3-46e0-bc05-fc34d69c1207 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:04.730067 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b6282e5-e4e3-46e0-bc05-fc34d69c1207 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:04.730067 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b6282e5-e4e3-46e0-bc05-fc34d69c1207 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:04.731619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b6282e5-e4e3-46e0-bc05-fc34d69c1207 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:04.731770 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b6282e5-e4e3-46e0-bc05-fc34d69c1207 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:04.897652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b6282e5-e4e3-46e0-bc05-fc34d69c1207 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:04.906134 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5b6282e5-e4e3-46e0-bc05-fc34d69c1207 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1750 microversion: 2.1 time: 0.190320 Jun 27 15:31:04.906716 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 279/567] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:04 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1750 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:05.926708 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-48d12880-1ed1-4c1d-b600-396cd0e489f0 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:05.927572 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-48d12880-1ed1-4c1d-b600-396cd0e489f0 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:05.935217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48d12880-1ed1-4c1d-b600-396cd0e489f0 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:05.935670 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48d12880-1ed1-4c1d-b600-396cd0e489f0 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:05.936491 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48d12880-1ed1-4c1d-b600-396cd0e489f0 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:05.936938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-48d12880-1ed1-4c1d-b600-396cd0e489f0 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:06.112977 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-48d12880-1ed1-4c1d-b600-396cd0e489f0 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:06.125328 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-48d12880-1ed1-4c1d-b600-396cd0e489f0 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1750 microversion: 2.1 time: 0.205011 Jun 27 15:31:06.126620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 289/568] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:05 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1750 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:07.147368 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-363c381a-4b29-48b6-bbdb-5acf2da44580 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:07.148057 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-363c381a-4b29-48b6-bbdb-5acf2da44580 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:07.155357 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-363c381a-4b29-48b6-bbdb-5acf2da44580 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:07.155805 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-363c381a-4b29-48b6-bbdb-5acf2da44580 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:07.156624 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-363c381a-4b29-48b6-bbdb-5acf2da44580 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:07.157061 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-363c381a-4b29-48b6-bbdb-5acf2da44580 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:07.286742 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-262632963", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "networks": [{"uuid": "05882426-bf21-41a8-ab57-641909717128"}]}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:07.322890 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-363c381a-4b29-48b6-bbdb-5acf2da44580 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:07.333677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-363c381a-4b29-48b6-bbdb-5acf2da44580 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.190183 Jun 27 15:31:07.334622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 280/569] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:07 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:07.346688 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] validate_networks() for [('05882426-bf21-41a8-ab57-641909717128', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:31:07.950175 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:31:07.950588 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:31:07.951191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:31:07.951739 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:31:07.952372 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:31:07.965406 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:07.965978 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:07.966774 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:07.967205 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:07.989190 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Getting quotas for project fe9612aa8fdd4be0a4a3ecfaefb96fca. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:31:07.993805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Getting quotas for user 4e1f142fbc2a4159b5ad3a672170db10 and project fe9612aa8fdd4be0a4a3ecfaefb96fca. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:31:08.006196 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:31:08.008555 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:31:08.055551 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-aa0c4bfa-6ea6-473d-a747-3b3ab0fabe25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.772672 Jun 27 15:31:08.056555 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 290/570] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:31:07 2022] POST /compute/v2.1/servers => generated 380 bytes in 774 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:31:08.067734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e24ef4fa-9280-4c18-a219-6970a44f0c13 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:08.068408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e24ef4fa-9280-4c18-a219-6970a44f0c13 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:08.142244 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e24ef4fa-9280-4c18-a219-6970a44f0c13 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:08.150705 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e24ef4fa-9280-4c18-a219-6970a44f0c13 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1218 microversion: 2.1 time: 0.086819 Jun 27 15:31:08.151733 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 281/571] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:08 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:31:08.353313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7f1f1580-0210-42e7-8223-e9c2e71b5f0a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:08.354044 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7f1f1580-0210-42e7-8223-e9c2e71b5f0a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:08.361811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f1f1580-0210-42e7-8223-e9c2e71b5f0a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:08.362367 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f1f1580-0210-42e7-8223-e9c2e71b5f0a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:08.363240 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f1f1580-0210-42e7-8223-e9c2e71b5f0a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:08.363915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f1f1580-0210-42e7-8223-e9c2e71b5f0a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:08.367790 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:08.538622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7f1f1580-0210-42e7-8223-e9c2e71b5f0a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:08.547508 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7f1f1580-0210-42e7-8223-e9c2e71b5f0a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.198781 Jun 27 15:31:08.548085 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 291/572] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:08 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:09.170902 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d8f2d711-8034-4650-8824-ef52b6b2c7d1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:09.171518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d8f2d711-8034-4650-8824-ef52b6b2c7d1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:09.179020 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d8f2d711-8034-4650-8824-ef52b6b2c7d1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:09.179515 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d8f2d711-8034-4650-8824-ef52b6b2c7d1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:09.180266 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d8f2d711-8034-4650-8824-ef52b6b2c7d1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:09.180733 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d8f2d711-8034-4650-8824-ef52b6b2c7d1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:09.252073 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d8f2d711-8034-4650-8824-ef52b6b2c7d1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:09.261524 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d8f2d711-8034-4650-8824-ef52b6b2c7d1 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1270 microversion: 2.1 time: 0.094523 Jun 27 15:31:09.262125 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 282/573] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:09 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:09.565543 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-72b01b8f-2d8e-4e7a-8cdf-0410a536d4b4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:09.566190 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-72b01b8f-2d8e-4e7a-8cdf-0410a536d4b4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:09.573738 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72b01b8f-2d8e-4e7a-8cdf-0410a536d4b4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:09.574223 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72b01b8f-2d8e-4e7a-8cdf-0410a536d4b4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:09.575125 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72b01b8f-2d8e-4e7a-8cdf-0410a536d4b4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:09.575568 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-72b01b8f-2d8e-4e7a-8cdf-0410a536d4b4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:09.750350 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-72b01b8f-2d8e-4e7a-8cdf-0410a536d4b4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:09.758957 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-72b01b8f-2d8e-4e7a-8cdf-0410a536d4b4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.197285 Jun 27 15:31:09.759574 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 292/574] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:09 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:10.280356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7f308e1e-a470-410c-9dee-44b16cade920 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:10.281277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7f308e1e-a470-410c-9dee-44b16cade920 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:10.289197 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7f308e1e-a470-410c-9dee-44b16cade920 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:10.289742 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7f308e1e-a470-410c-9dee-44b16cade920 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:10.290925 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7f308e1e-a470-410c-9dee-44b16cade920 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:10.291500 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7f308e1e-a470-410c-9dee-44b16cade920 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:10.578330 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7f308e1e-a470-410c-9dee-44b16cade920 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:10.587495 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7f308e1e-a470-410c-9dee-44b16cade920 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1318 microversion: 2.1 time: 0.311572 Jun 27 15:31:10.588107 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 283/575] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:10 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:10.776890 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-db1ad470-58ad-415a-8d54-bc622fbc9fd1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:10.778268 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-db1ad470-58ad-415a-8d54-bc622fbc9fd1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:10.785979 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db1ad470-58ad-415a-8d54-bc622fbc9fd1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:10.786471 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db1ad470-58ad-415a-8d54-bc622fbc9fd1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:10.787261 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db1ad470-58ad-415a-8d54-bc622fbc9fd1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:10.787688 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db1ad470-58ad-415a-8d54-bc622fbc9fd1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:10.957232 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-06405c9f-6ac2-4628-b6a7-f36f08413c04 req-7fc40f5e-f1a9-4572-b19d-6f1d15f4dad0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edb0650f-918c-45f5-8739-099eb50c3e9a", "tag": "c4f0c948-b5c3-4c06-8187-bac9f967d7ff"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:10.966897 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-db1ad470-58ad-415a-8d54-bc622fbc9fd1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:10.972305 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-06405c9f-6ac2-4628-b6a7-f36f08413c04 req-7fc40f5e-f1a9-4572-b19d-6f1d15f4dad0 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:10.973097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-06405c9f-6ac2-4628-b6a7-f36f08413c04 req-7fc40f5e-f1a9-4572-b19d-6f1d15f4dad0 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:10.976639 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-db1ad470-58ad-415a-8d54-bc622fbc9fd1 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.203716 Jun 27 15:31:10.977294 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 293/576] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:10 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:10.996574 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-06405c9f-6ac2-4628-b6a7-f36f08413c04 req-7fc40f5e-f1a9-4572-b19d-6f1d15f4dad0 service nova] Creating event network-changed:c4f0c948-b5c3-4c06-8187-bac9f967d7ff for instance edb0650f-918c-45f5-8739-099eb50c3e9a on hv-cinder-84779 Jun 27 15:31:11.004553 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-06405c9f-6ac2-4628-b6a7-f36f08413c04 req-7fc40f5e-f1a9-4572-b19d-6f1d15f4dad0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055686 Jun 27 15:31:11.005300 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 284/577] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:11.605049 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4c5dfdda-cf02-44bb-9865-4666a0bd795a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:11.605677 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4c5dfdda-cf02-44bb-9865-4666a0bd795a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:11.612036 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c5dfdda-cf02-44bb-9865-4666a0bd795a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:11.612521 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c5dfdda-cf02-44bb-9865-4666a0bd795a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:11.613297 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c5dfdda-cf02-44bb-9865-4666a0bd795a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:11.613728 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c5dfdda-cf02-44bb-9865-4666a0bd795a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:11.624848 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-41bf4782-1d60-4c5e-b71d-b76957179a98 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:11.625647 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-41bf4782-1d60-4c5e-b71d-b76957179a98 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:11.632350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41bf4782-1d60-4c5e-b71d-b76957179a98 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:11.632802 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41bf4782-1d60-4c5e-b71d-b76957179a98 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:11.633588 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41bf4782-1d60-4c5e-b71d-b76957179a98 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:11.634022 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41bf4782-1d60-4c5e-b71d-b76957179a98 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:11.668056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-41bf4782-1d60-4c5e-b71d-b76957179a98 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments/9cfb74b5-8b17-49e4-9139-d0348dc74a10" status: 200 len: 194 microversion: 2.20 time: 0.048753 Jun 27 15:31:11.668963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 285/578] 10.222.0.26 () {60 vars in 1453 bytes} [Mon Jun 27 15:31:11 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments/9cfb74b5-8b17-49e4-9139-d0348dc74a10 => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:31:11.760181 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3b5eed15-dca6-4082-a010-ba5456bdfce0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:11.760701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3b5eed15-dca6-4082-a010-ba5456bdfce0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:11.767716 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b5eed15-dca6-4082-a010-ba5456bdfce0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:11.768174 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b5eed15-dca6-4082-a010-ba5456bdfce0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:11.768958 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b5eed15-dca6-4082-a010-ba5456bdfce0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:11.769390 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b5eed15-dca6-4082-a010-ba5456bdfce0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:11.770228 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4c5dfdda-cf02-44bb-9865-4666a0bd795a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:11.778539 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4c5dfdda-cf02-44bb-9865-4666a0bd795a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1318 microversion: 2.1 time: 0.177421 Jun 27 15:31:11.779444 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 294/579] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:11 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:11.857520 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-3b5eed15-dca6-4082-a010-ba5456bdfce0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lazy-loading 'services' on Instance uuid 831291d0-f04d-4927-afcd-88fd058db642 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:11.940115 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3b5eed15-dca6-4082-a010-ba5456bdfce0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "DELETE /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments/9cfb74b5-8b17-49e4-9139-d0348dc74a10" status: 202 len: 0 microversion: 2.20 time: 0.183600 Jun 27 15:31:11.940658 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 286/580] 10.222.0.26 () {60 vars in 1456 bytes} [Mon Jun 27 15:31:11 2022] DELETE /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments/9cfb74b5-8b17-49e4-9139-d0348dc74a10 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:31:11.949574 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-29ae7b98-725d-4156-9ddd-8988a3114dd7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:11.950871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-29ae7b98-725d-4156-9ddd-8988a3114dd7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:11.959005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29ae7b98-725d-4156-9ddd-8988a3114dd7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:11.959450 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29ae7b98-725d-4156-9ddd-8988a3114dd7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:11.960595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29ae7b98-725d-4156-9ddd-8988a3114dd7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:11.961051 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29ae7b98-725d-4156-9ddd-8988a3114dd7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:11.995324 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7ac0cd6b-10f7-4382-a584-6a636f58190a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:11.996216 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7ac0cd6b-10f7-4382-a584-6a636f58190a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:11.997179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-29ae7b98-725d-4156-9ddd-8988a3114dd7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051464 Jun 27 15:31:11.997864 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 295/581] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jun 27 15:31:11 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:31:12.003258 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7ac0cd6b-10f7-4382-a584-6a636f58190a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:12.003707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7ac0cd6b-10f7-4382-a584-6a636f58190a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:12.004557 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7ac0cd6b-10f7-4382-a584-6a636f58190a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:12.005080 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7ac0cd6b-10f7-4382-a584-6a636f58190a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:12.161271 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7ac0cd6b-10f7-4382-a584-6a636f58190a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:12.169821 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7ac0cd6b-10f7-4382-a584-6a636f58190a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.178733 Jun 27 15:31:12.170464 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 287/582] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:11 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:12.795897 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-76e61cf6-60a2-498e-8829-be359d66b875 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:12.796551 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-76e61cf6-60a2-498e-8829-be359d66b875 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:12.803233 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76e61cf6-60a2-498e-8829-be359d66b875 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:12.803663 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76e61cf6-60a2-498e-8829-be359d66b875 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:12.804490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76e61cf6-60a2-498e-8829-be359d66b875 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:12.804927 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76e61cf6-60a2-498e-8829-be359d66b875 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:12.972875 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-76e61cf6-60a2-498e-8829-be359d66b875 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:12.982415 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-76e61cf6-60a2-498e-8829-be359d66b875 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1318 microversion: 2.1 time: 0.190429 Jun 27 15:31:12.983133 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 296/583] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:12 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1318 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:13.009697 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e766398e-6273-4b09-ab67-f79ec5423b5d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:13.010719 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e766398e-6273-4b09-ab67-f79ec5423b5d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:13.018357 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e766398e-6273-4b09-ab67-f79ec5423b5d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:13.018813 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e766398e-6273-4b09-ab67-f79ec5423b5d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:13.019614 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e766398e-6273-4b09-ab67-f79ec5423b5d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:13.020054 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e766398e-6273-4b09-ab67-f79ec5423b5d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:13.054049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e766398e-6273-4b09-ab67-f79ec5423b5d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048578 Jun 27 15:31:13.054556 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 288/584] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jun 27 15:31:13 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:31:13.188213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-32600afc-89a6-482e-8430-857ded15291e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:13.188986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-32600afc-89a6-482e-8430-857ded15291e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:13.195767 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32600afc-89a6-482e-8430-857ded15291e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:13.196219 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32600afc-89a6-482e-8430-857ded15291e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:13.197035 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32600afc-89a6-482e-8430-857ded15291e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:13.197475 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32600afc-89a6-482e-8430-857ded15291e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:13.354959 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-32600afc-89a6-482e-8430-857ded15291e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:13.364148 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-32600afc-89a6-482e-8430-857ded15291e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.180067 Jun 27 15:31:13.364816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 297/585] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:13 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:14.004628 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9fb5477a-5e3b-4f1d-973a-ce033447977a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:14.005724 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9fb5477a-5e3b-4f1d-973a-ce033447977a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:14.014045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9fb5477a-5e3b-4f1d-973a-ce033447977a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:14.014657 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9fb5477a-5e3b-4f1d-973a-ce033447977a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:14.015282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9fb5477a-5e3b-4f1d-973a-ce033447977a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:14.015727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9fb5477a-5e3b-4f1d-973a-ce033447977a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:14.066396 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b8b9abf9-0dd3-4d23-b8dd-d7cfc5da3c59 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:14.067438 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b8b9abf9-0dd3-4d23-b8dd-d7cfc5da3c59 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:14.074712 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8b9abf9-0dd3-4d23-b8dd-d7cfc5da3c59 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:14.075369 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8b9abf9-0dd3-4d23-b8dd-d7cfc5da3c59 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:14.076034 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8b9abf9-0dd3-4d23-b8dd-d7cfc5da3c59 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:14.076516 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b8b9abf9-0dd3-4d23-b8dd-d7cfc5da3c59 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:14.113179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b8b9abf9-0dd3-4d23-b8dd-d7cfc5da3c59 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050896 Jun 27 15:31:14.113765 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 298/586] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jun 27 15:31:14 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:14.167067 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9fb5477a-5e3b-4f1d-973a-ce033447977a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:14.176609 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9fb5477a-5e3b-4f1d-973a-ce033447977a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1318 microversion: 2.1 time: 0.179407 Jun 27 15:31:14.176823 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0ca275cf-1858-4791-a745-e15f747d9169 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:14.177115 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0ca275cf-1858-4791-a745-e15f747d9169 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:14.177210 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 289/587] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:13 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:14.183535 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ca275cf-1858-4791-a745-e15f747d9169 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:14.183975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ca275cf-1858-4791-a745-e15f747d9169 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:14.185059 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ca275cf-1858-4791-a745-e15f747d9169 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:14.187764 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0ca275cf-1858-4791-a745-e15f747d9169 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:14.219423 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0ca275cf-1858-4791-a745-e15f747d9169 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:31:14.315970 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0ca275cf-1858-4791-a745-e15f747d9169 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "DELETE /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 204 len: 0 microversion: 2.20 time: 0.142898 Jun 27 15:31:14.316897 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 299/588] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jun 27 15:31:14 2022] DELETE /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 27 15:31:14.330931 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d763a5e0-053e-495c-b376-8f8f1e083c12 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:14.332038 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d763a5e0-053e-495c-b376-8f8f1e083c12 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:14.342733 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d763a5e0-053e-495c-b376-8f8f1e083c12 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:14.343522 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d763a5e0-053e-495c-b376-8f8f1e083c12 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:14.344865 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d763a5e0-053e-495c-b376-8f8f1e083c12 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:14.345642 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d763a5e0-053e-495c-b376-8f8f1e083c12 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:14.383171 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3ce62f2b-3f65-419f-a5f4-21d3aeacf3a8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:14.383768 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3ce62f2b-3f65-419f-a5f4-21d3aeacf3a8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:14.391251 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3ce62f2b-3f65-419f-a5f4-21d3aeacf3a8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:14.391799 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3ce62f2b-3f65-419f-a5f4-21d3aeacf3a8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:14.392691 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3ce62f2b-3f65-419f-a5f4-21d3aeacf3a8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:14.393191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3ce62f2b-3f65-419f-a5f4-21d3aeacf3a8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:14.525401 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d763a5e0-053e-495c-b376-8f8f1e083c12 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:14.535085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d763a5e0-053e-495c-b376-8f8f1e083c12 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:14.536655 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d763a5e0-053e-495c-b376-8f8f1e083c12 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:14.537843 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d763a5e0-053e-495c-b376-8f8f1e083c12 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.214350 Jun 27 15:31:14.538415 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 290/589] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:14 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:14.568235 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3ce62f2b-3f65-419f-a5f4-21d3aeacf3a8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:14.577116 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3ce62f2b-3f65-419f-a5f4-21d3aeacf3a8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.198298 Jun 27 15:31:14.577693 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 300/590] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:14 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:15.195998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2c88d1ef-490f-44a1-ad71-848259126b6a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:15.196819 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2c88d1ef-490f-44a1-ad71-848259126b6a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:15.205095 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2c88d1ef-490f-44a1-ad71-848259126b6a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:15.206016 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2c88d1ef-490f-44a1-ad71-848259126b6a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:15.207166 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2c88d1ef-490f-44a1-ad71-848259126b6a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:15.207771 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2c88d1ef-490f-44a1-ad71-848259126b6a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:15.350598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2c88d1ef-490f-44a1-ad71-848259126b6a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:15.358713 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2c88d1ef-490f-44a1-ad71-848259126b6a tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1318 microversion: 2.1 time: 0.167296 Jun 27 15:31:15.359514 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 291/591] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:15 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:15.557283 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-43ad7792-801b-4967-b150-9c688e63b5eb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:15.558473 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-43ad7792-801b-4967-b150-9c688e63b5eb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:15.565921 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43ad7792-801b-4967-b150-9c688e63b5eb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:15.566544 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43ad7792-801b-4967-b150-9c688e63b5eb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:15.567637 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43ad7792-801b-4967-b150-9c688e63b5eb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:15.568235 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-43ad7792-801b-4967-b150-9c688e63b5eb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:15.594616 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-561a853d-4ede-404b-9f00-434352036770 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:15.595229 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-561a853d-4ede-404b-9f00-434352036770 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:15.601542 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-561a853d-4ede-404b-9f00-434352036770 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:15.602000 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-561a853d-4ede-404b-9f00-434352036770 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:15.602772 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-561a853d-4ede-404b-9f00-434352036770 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:15.603212 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-561a853d-4ede-404b-9f00-434352036770 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:15.719158 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-43ad7792-801b-4967-b150-9c688e63b5eb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:15.734992 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-43ad7792-801b-4967-b150-9c688e63b5eb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:15.738223 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-43ad7792-801b-4967-b150-9c688e63b5eb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:15.740592 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-43ad7792-801b-4967-b150-9c688e63b5eb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.187504 Jun 27 15:31:15.741580 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 301/592] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:15 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:15.763254 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-561a853d-4ede-404b-9f00-434352036770 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:15.771405 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-561a853d-4ede-404b-9f00-434352036770 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.180731 Jun 27 15:31:15.771919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 292/593] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:15 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:16.375460 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8fb60402-6707-46a9-b46a-8fd3439143c0 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:16.376067 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8fb60402-6707-46a9-b46a-8fd3439143c0 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:16.385524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fb60402-6707-46a9-b46a-8fd3439143c0 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:16.386183 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fb60402-6707-46a9-b46a-8fd3439143c0 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:16.387717 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fb60402-6707-46a9-b46a-8fd3439143c0 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:16.388168 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8fb60402-6707-46a9-b46a-8fd3439143c0 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:16.656920 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8fb60402-6707-46a9-b46a-8fd3439143c0 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:16.670842 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8fb60402-6707-46a9-b46a-8fd3439143c0 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1318 microversion: 2.1 time: 0.298868 Jun 27 15:31:16.671837 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 302/594] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:16 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1318 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:16.759557 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ef367a3b-9c53-41c0-afed-62c26b705d3d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:16.760239 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ef367a3b-9c53-41c0-afed-62c26b705d3d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:16.767606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ef367a3b-9c53-41c0-afed-62c26b705d3d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:16.768055 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ef367a3b-9c53-41c0-afed-62c26b705d3d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:16.768916 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ef367a3b-9c53-41c0-afed-62c26b705d3d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:16.769348 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ef367a3b-9c53-41c0-afed-62c26b705d3d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:16.789616 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9dd4a06-dfda-493d-9c45-b7afc21a76fc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:16.790817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9dd4a06-dfda-493d-9c45-b7afc21a76fc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:16.798453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9dd4a06-dfda-493d-9c45-b7afc21a76fc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:16.798909 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9dd4a06-dfda-493d-9c45-b7afc21a76fc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:16.799697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9dd4a06-dfda-493d-9c45-b7afc21a76fc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:16.800138 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9dd4a06-dfda-493d-9c45-b7afc21a76fc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:16.959178 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9dd4a06-dfda-493d-9c45-b7afc21a76fc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:16.968043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9dd4a06-dfda-493d-9c45-b7afc21a76fc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.183237 Jun 27 15:31:16.968778 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 303/595] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:16 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:16.979660 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ef367a3b-9c53-41c0-afed-62c26b705d3d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:16.989402 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ef367a3b-9c53-41c0-afed-62c26b705d3d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:16.991120 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ef367a3b-9c53-41c0-afed-62c26b705d3d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:16.992997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ef367a3b-9c53-41c0-afed-62c26b705d3d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1722 microversion: 2.20 time: 0.237304 Jun 27 15:31:16.993887 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 293/596] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:16 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:17.202553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-f63a890f-ea20-482f-88aa-6dcc9f556e8c req-620c74bc-ab08-415f-9166-ab35eea0c8c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb0650f-918c-45f5-8739-099eb50c3e9a", "name": "network-vif-plugged", "status": "completed", "tag": "c4f0c948-b5c3-4c06-8187-bac9f967d7ff"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:17.212249 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f63a890f-ea20-482f-88aa-6dcc9f556e8c req-620c74bc-ab08-415f-9166-ab35eea0c8c9 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:17.212753 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f63a890f-ea20-482f-88aa-6dcc9f556e8c req-620c74bc-ab08-415f-9166-ab35eea0c8c9 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:17.225565 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-f63a890f-ea20-482f-88aa-6dcc9f556e8c req-620c74bc-ab08-415f-9166-ab35eea0c8c9 service nova] Creating event network-vif-plugged:c4f0c948-b5c3-4c06-8187-bac9f967d7ff for instance edb0650f-918c-45f5-8739-099eb50c3e9a on hv-cinder-84779 Jun 27 15:31:17.230839 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-f63a890f-ea20-482f-88aa-6dcc9f556e8c req-620c74bc-ab08-415f-9166-ab35eea0c8c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032992 Jun 27 15:31:17.232022 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 304/597] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:17.666976 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-f122e3a4-d93e-45d1-ae46-8e984e863cdb req-aac08fda-d00e-4d7e-98a4-c2239e930d66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "831291d0-f04d-4927-afcd-88fd058db642", "name": "network-vif-deleted", "tag": "62696634-23e0-4313-bcf8-d3be6665d3aa"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:17.678444 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-f122e3a4-d93e-45d1-ae46-8e984e863cdb req-aac08fda-d00e-4d7e-98a4-c2239e930d66 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:17.679156 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-f122e3a4-d93e-45d1-ae46-8e984e863cdb req-aac08fda-d00e-4d7e-98a4-c2239e930d66 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:17.696107 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-f122e3a4-d93e-45d1-ae46-8e984e863cdb req-aac08fda-d00e-4d7e-98a4-c2239e930d66 service nova] Creating event network-vif-deleted:62696634-23e0-4313-bcf8-d3be6665d3aa for instance 831291d0-f04d-4927-afcd-88fd058db642 on hv-cinder-84779 Jun 27 15:31:17.696688 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dbb13826-87a2-4907-9a03-eede70f104fb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:17.697442 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dbb13826-87a2-4907-9a03-eede70f104fb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:17.702714 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-f122e3a4-d93e-45d1-ae46-8e984e863cdb req-aac08fda-d00e-4d7e-98a4-c2239e930d66 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040954 Jun 27 15:31:17.703832 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 294/598] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:17.706649 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbb13826-87a2-4907-9a03-eede70f104fb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:17.707361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbb13826-87a2-4907-9a03-eede70f104fb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:17.708538 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbb13826-87a2-4907-9a03-eede70f104fb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:17.709301 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbb13826-87a2-4907-9a03-eede70f104fb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:17.854316 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dbb13826-87a2-4907-9a03-eede70f104fb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:17.864356 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dbb13826-87a2-4907-9a03-eede70f104fb tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1318 microversion: 2.1 time: 0.172416 Jun 27 15:31:17.865263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 305/599] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:17 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:17.987531 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-495b6a2a-9b27-4e53-9475-b91999642325 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:17.988351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-495b6a2a-9b27-4e53-9475-b91999642325 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:17.995633 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-495b6a2a-9b27-4e53-9475-b91999642325 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:17.996105 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-495b6a2a-9b27-4e53-9475-b91999642325 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:17.997274 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-495b6a2a-9b27-4e53-9475-b91999642325 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:17.997939 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-495b6a2a-9b27-4e53-9475-b91999642325 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:18.001042 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:18.017328 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2ed42067-962c-4504-acad-0cea4e307003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:18.017950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2ed42067-962c-4504-acad-0cea4e307003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:18.020063 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:18.020754 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:18.027609 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ed42067-962c-4504-acad-0cea4e307003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:18.028221 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ed42067-962c-4504-acad-0cea4e307003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:18.030051 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ed42067-962c-4504-acad-0cea4e307003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:18.030179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2ed42067-962c-4504-acad-0cea4e307003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:18.125767 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2ed42067-962c-4504-acad-0cea4e307003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:18.128266 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:18.136772 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2ed42067-962c-4504-acad-0cea4e307003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:18.139909 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2ed42067-962c-4504-acad-0cea4e307003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:18.141146 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2ed42067-962c-4504-acad-0cea4e307003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1364 microversion: 2.20 time: 0.131629 Jun 27 15:31:18.147263 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:18.152039 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 306/600] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:18 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1364 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:31:18.233705 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-495b6a2a-9b27-4e53-9475-b91999642325 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:18.242189 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-495b6a2a-9b27-4e53-9475-b91999642325 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.259707 Jun 27 15:31:18.243086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 295/601] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:17 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:18.886927 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-50e4d1ff-e66f-45a2-a5fb-7160d57e2caf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:18.887994 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-50e4d1ff-e66f-45a2-a5fb-7160d57e2caf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:18.901040 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50e4d1ff-e66f-45a2-a5fb-7160d57e2caf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:18.901490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50e4d1ff-e66f-45a2-a5fb-7160d57e2caf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:18.902289 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50e4d1ff-e66f-45a2-a5fb-7160d57e2caf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:18.902728 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-50e4d1ff-e66f-45a2-a5fb-7160d57e2caf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:19.073322 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-50e4d1ff-e66f-45a2-a5fb-7160d57e2caf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:19.083164 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-50e4d1ff-e66f-45a2-a5fb-7160d57e2caf tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1318 microversion: 2.1 time: 0.203096 Jun 27 15:31:19.083164 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 307/602] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:18 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:19.159941 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:19.160570 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:19.168006 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:19.168703 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:19.170126 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:19.170560 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:19.209993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:19.210549 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:19.211134 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lazy-loading 'fault' on Instance uuid 831291d0-f04d-4927-afcd-88fd058db642 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:19.261512 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-31536a59-e4b6-49d6-9893-75b8a4b2b7ef tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:19.264143 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-31536a59-e4b6-49d6-9893-75b8a4b2b7ef tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:19.267676 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:19.274008 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31536a59-e4b6-49d6-9893-75b8a4b2b7ef tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:19.274464 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31536a59-e4b6-49d6-9893-75b8a4b2b7ef tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:19.275248 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31536a59-e4b6-49d6-9893-75b8a4b2b7ef tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:19.275688 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-31536a59-e4b6-49d6-9893-75b8a4b2b7ef tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:19.276295 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:19.277913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:19.279277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-753fc1b2-e8ac-43bc-bb7f-8491752b5a91 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 200 len: 1369 microversion: 2.20 time: 0.123469 Jun 27 15:31:19.280082 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 296/603] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:19 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 1369 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:19.442809 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-31536a59-e4b6-49d6-9893-75b8a4b2b7ef tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:19.452016 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-31536a59-e4b6-49d6-9893-75b8a4b2b7ef tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.196721 Jun 27 15:31:19.452636 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 308/604] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:19 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:31:20.100700 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8dc6288a-6419-4aec-9bee-4acbe0480ce6 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:20.101757 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8dc6288a-6419-4aec-9bee-4acbe0480ce6 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:20.114440 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8dc6288a-6419-4aec-9bee-4acbe0480ce6 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:20.114899 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8dc6288a-6419-4aec-9bee-4acbe0480ce6 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:20.115666 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8dc6288a-6419-4aec-9bee-4acbe0480ce6 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:20.116097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8dc6288a-6419-4aec-9bee-4acbe0480ce6 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:20.273808 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-8dc6288a-6419-4aec-9bee-4acbe0480ce6 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:20.282551 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8dc6288a-6419-4aec-9bee-4acbe0480ce6 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1507 microversion: 2.1 time: 0.186240 Jun 27 15:31:20.283205 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 297/605] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:20 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:20.299548 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d350ff28-7c86-4489-b5f0-85ab8f83a979 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:20.300227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d350ff28-7c86-4489-b5f0-85ab8f83a979 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:20.301275 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5eb659ef-e45b-48bd-989a-6a63e16e4650 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e9820811-39a2-42c3-8b8e-b184ee069726", "device": "/dev/sdb"}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:20.302457 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5eb659ef-e45b-48bd-989a-6a63e16e4650 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:20.308573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d350ff28-7c86-4489-b5f0-85ab8f83a979 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:20.308573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d350ff28-7c86-4489-b5f0-85ab8f83a979 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:20.316245 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d350ff28-7c86-4489-b5f0-85ab8f83a979 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:20.316245 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d350ff28-7c86-4489-b5f0-85ab8f83a979 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:20.316440 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5eb659ef-e45b-48bd-989a-6a63e16e4650 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:20.316440 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5eb659ef-e45b-48bd-989a-6a63e16e4650 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:20.316440 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5eb659ef-e45b-48bd-989a-6a63e16e4650 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:20.316440 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5eb659ef-e45b-48bd-989a-6a63e16e4650 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:20.324817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-d350ff28-7c86-4489-b5f0-85ab8f83a979 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] HTTP exception thrown: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d350ff28-7c86-4489-b5f0-85ab8f83a979 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Request method failure captured: Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 HTTP/1.1 Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwzJwIGTsE3cSGbwc0yM_dXyHrCZE3lJKshl297HIXJNMWy8k0GI_Eu5U6EqQfyUsckbTEuanQJUvay9ZpSoXtqyrhaI5dSzOg_9QHzWNqlV-wbBHntm5i-OH9La2rBcmiEJ8ZYmtvWrYI9Bted2oj7y0rvmpApXRpslcz9SflcmKM Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:31:20.327026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2270daf238a640609e9ab514b01d9768", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2270daf238a640609e9ab514b01d9768"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: e9dab30db0a44655828384db53df29f9 Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:31:20.328731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '831291d0-f04d-4927-afcd-88fd058db642'} Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:31:20.329498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:31:20.330623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:20.331762 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d350ff28-7c86-4489-b5f0-85ab8f83a979 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Returning 404 to user: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:31:20.331762 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d350ff28-7c86-4489-b5f0-85ab8f83a979 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 404 len: 111 microversion: 2.20 time: 0.033016 Jun 27 15:31:20.332536 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 309/606] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:20 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:31:20.337620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5742b52e-3025-4483-80b0-bddf618a60d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '.version_select at 0x7fb273548280>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:20.360947 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5742b52e-3025-4483-80b0-bddf618a60d7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-55710631" status: 204 len: 0 microversion: 2.20 time: 0.027025 Jun 27 15:31:20.361770 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 310/607] 10.222.0.26 () {60 vars in 1255 bytes} [Mon Jun 27 15:31:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-55710631 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 15:31:20.469392 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fab0b19c-54e5-4803-bef5-c3b2d087cebc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:20.470091 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fab0b19c-54e5-4803-bef5-c3b2d087cebc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:20.477453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fab0b19c-54e5-4803-bef5-c3b2d087cebc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:20.478208 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fab0b19c-54e5-4803-bef5-c3b2d087cebc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:20.479182 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fab0b19c-54e5-4803-bef5-c3b2d087cebc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:20.479812 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fab0b19c-54e5-4803-bef5-c3b2d087cebc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:20.665093 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5eb659ef-e45b-48bd-989a-6a63e16e4650 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "POST /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.367419 Jun 27 15:31:20.673681 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 298/608] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:31:20 2022] POST /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a/os-volume_attachments => generated 194 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:31:20.756860 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fab0b19c-54e5-4803-bef5-c3b2d087cebc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:20.766549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fab0b19c-54e5-4803-bef5-c3b2d087cebc tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.301316 Jun 27 15:31:20.768143 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 311/609] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:20 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:21.210143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ba45ff4f-dcb6-4a63-b302-e334450b2677 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Action: 'create', calling method: .version_select at 0x7fb27363ec10>, body: {"keypair": {"name": "tempest-keypair-1863617111", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAp8nid6st/7AKoci6XeZyUH/0vATuYlrYOpCSQIBDwCGu+AEgQ03J0E+MQSQI870bcJb+luJl3J0IkLhq6wKeNEH3B7zOfpp1Dta2myiquKoyb3pAgdThksrPCcvErBPw=="}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:21.227473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-ba45ff4f-dcb6-4a63-b302-e334450b2677 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Getting quotas for project 2270daf238a640609e9ab514b01d9768. Resources: {'key_pairs'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:31:21.231358 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-ba45ff4f-dcb6-4a63-b302-e334450b2677 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Getting quotas for user e9dab30db0a44655828384db53df29f9 and project 2270daf238a640609e9ab514b01d9768. Resources: {'key_pairs'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:31:21.257347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ba45ff4f-dcb6-4a63-b302-e334450b2677 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.052644 Jun 27 15:31:21.258034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 299/610] 10.222.0.26 () {62 vars in 1199 bytes} [Mon Jun 27 15:31:21 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 27 15:31:21.784199 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-699f6436-8675-45f1-a542-ceed8089f8ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:21.784854 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-699f6436-8675-45f1-a542-ceed8089f8ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:21.792446 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-699f6436-8675-45f1-a542-ceed8089f8ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:21.792900 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-699f6436-8675-45f1-a542-ceed8089f8ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:21.793701 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-699f6436-8675-45f1-a542-ceed8089f8ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:21.794554 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-699f6436-8675-45f1-a542-ceed8089f8ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:21.947139 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7101426f-570e-4a85-b508-336c37efe275 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:21.947980 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7101426f-570e-4a85-b508-336c37efe275 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:21.958076 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7101426f-570e-4a85-b508-336c37efe275 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:21.958836 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7101426f-570e-4a85-b508-336c37efe275 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:21.960215 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7101426f-570e-4a85-b508-336c37efe275 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:21.961023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7101426f-570e-4a85-b508-336c37efe275 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:22.001997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7101426f-570e-4a85-b508-336c37efe275 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879/ips" status: 200 len: 148 microversion: 2.1 time: 0.059337 Jun 27 15:31:22.002649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 300/611] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jun 27 15:31:21 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879/ips => generated 148 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:22.019577 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-05918ca9-847e-4e67-bd42-b10b3d794488 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3fdf0667-b5ba-4255-96b3-a97fcb765b67"}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:22.021097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-05918ca9-847e-4e67-bd42-b10b3d794488 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:22.029010 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-05918ca9-847e-4e67-bd42-b10b3d794488 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:22.029721 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-05918ca9-847e-4e67-bd42-b10b3d794488 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:22.030754 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-05918ca9-847e-4e67-bd42-b10b3d794488 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:22.031284 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-05918ca9-847e-4e67-bd42-b10b3d794488 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:22.059892 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-699f6436-8675-45f1-a542-ceed8089f8ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:22.080529 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-699f6436-8675-45f1-a542-ceed8089f8ae tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.299363 Jun 27 15:31:22.081744 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 312/612] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:21 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:22.152487 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-05918ca9-847e-4e67-bd42-b10b3d794488 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Invalid volume: volume 3fdf0667-b5ba-4255-96b3-a97fcb765b67 is already attached to instances: 598844cf-f73b-4630-ad12-f08ab67e89e3 Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-05918ca9-847e-4e67-bd42-b10b3d794488 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: POST /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879/os-volume_attachments HTTP/1.1 Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 74 Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:31:22.154701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {"volumeAttachment": {"volumeId": "3fdf0667-b5ba-4255-96b3-a97fcb765b67"}} Jun 27 15:31:22.157688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Invalid volume: volume 3fdf0667-b5ba-4255-96b3-a97fcb765b67 is already attached to instances: 598844cf-f73b-4630-ad12-f08ab67e89e3 Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'server_id': 'b669df6d-2c11-4910-bdc8-0eb82915b879', 'body': {'volumeAttachment': {'volumeId': '3fdf0667-b5ba-4255-96b3-a97fcb765b67'}}} Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 3fdf0667-b5ba-4255-96b3-a97fcb765b67 is already attached to instances: 598844cf-f73b-4630-ad12-f08ab67e89e3 Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:22.159097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 3fdf0667-b5ba-4255-96b3-a97fcb765b67 is already attached to instances: 598844cf-f73b-4630-ad12-f08ab67e89e3 Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:22.161579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:22.164090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:22.164090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:31:22.164090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:31:22.164090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 3fdf0667-b5ba-4255-96b3-a97fcb765b67 is already attached to instances: 598844cf-f73b-4630-ad12-f08ab67e89e3 Jun 27 15:31:22.164090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:22.164090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-05918ca9-847e-4e67-bd42-b10b3d794488 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 400 to user: Invalid volume: volume 3fdf0667-b5ba-4255-96b3-a97fcb765b67 is already attached to instances: 598844cf-f73b-4630-ad12-f08ab67e89e3 {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:31:22.164090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-05918ca9-847e-4e67-bd42-b10b3d794488 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.142002 Jun 27 15:31:22.164090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 301/613] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:31:22 2022] POST /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879/os-volume_attachments => generated 174 bytes in 144 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:31:22.171905 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-76b804e5-680f-40cb-aec0-196718c7e8ff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:22.172683 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-76b804e5-680f-40cb-aec0-196718c7e8ff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:22.182741 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76b804e5-680f-40cb-aec0-196718c7e8ff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:22.183870 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76b804e5-680f-40cb-aec0-196718c7e8ff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:22.185312 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76b804e5-680f-40cb-aec0-196718c7e8ff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:22.186134 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-76b804e5-680f-40cb-aec0-196718c7e8ff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:22.229046 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-76b804e5-680f-40cb-aec0-196718c7e8ff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:31:22.327935 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-76b804e5-680f-40cb-aec0-196718c7e8ff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 204 len: 0 microversion: 2.1 time: 0.162967 Jun 27 15:31:22.332370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 313/614] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:31:22 2022] DELETE /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:31:22.339773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8be831b9-14a5-433a-83a6-555fc15e54ef tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:22.340717 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8be831b9-14a5-433a-83a6-555fc15e54ef tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:22.352754 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8be831b9-14a5-433a-83a6-555fc15e54ef tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:22.353474 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8be831b9-14a5-433a-83a6-555fc15e54ef tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:22.354366 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8be831b9-14a5-433a-83a6-555fc15e54ef tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:22.354887 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8be831b9-14a5-433a-83a6-555fc15e54ef tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:22.513093 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-8be831b9-14a5-433a-83a6-555fc15e54ef tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:22.521103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8be831b9-14a5-433a-83a6-555fc15e54ef tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1681 microversion: 2.1 time: 0.186819 Jun 27 15:31:22.521678 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 302/615] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:22 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1681 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:22.860514 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-748625284", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e8e77f3f-2787-4f23-b11e-9e909cc074b3"}], "security_groups": [{"name": "tempest-securitygroup--259626078"}], "key_name": "tempest-keypair-1863617111", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:22.967756 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] validate_networks() for [('e8e77f3f-2787-4f23-b11e-9e909cc074b3', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:31:23.106775 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3ed4777b-8251-4a24-812a-2632c6ca59b5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:23.107376 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3ed4777b-8251-4a24-812a-2632c6ca59b5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:23.114801 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3ed4777b-8251-4a24-812a-2632c6ca59b5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:23.115250 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3ed4777b-8251-4a24-812a-2632c6ca59b5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:23.116021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3ed4777b-8251-4a24-812a-2632c6ca59b5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:23.116486 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3ed4777b-8251-4a24-812a-2632c6ca59b5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:23.280161 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3ed4777b-8251-4a24-812a-2632c6ca59b5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:23.289229 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3ed4777b-8251-4a24-812a-2632c6ca59b5 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.186491 Jun 27 15:31:23.289723 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 303/616] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:23 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:23.367149 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:31:23.367571 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:31:23.368065 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:31:23.368503 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:31:23.368947 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:31:23.378545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:23.378996 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:23.379795 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:23.380227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:23.398611 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Getting quotas for project 2270daf238a640609e9ab514b01d9768. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:31:23.402833 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Getting quotas for user e9dab30db0a44655828384db53df29f9 and project 2270daf238a640609e9ab514b01d9768. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:31:23.412145 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:23.414768 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:31:23.417254 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:31:23.466489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4fcbf010-1f48-4e9a-af56-32fe7c65eaac tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.611058 Jun 27 15:31:23.467379 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 314/617] 10.222.0.26 () {62 vars in 1187 bytes} [Mon Jun 27 15:31:22 2022] POST /compute/v2.1/servers => generated 401 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 15:31:23.478046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-0e029c8d-e5fd-4871-a9aa-5bcbf4a7221f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:23.478647 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-0e029c8d-e5fd-4871-a9aa-5bcbf4a7221f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:23.532296 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-0e029c8d-e5fd-4871-a9aa-5bcbf4a7221f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:23.539692 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-0e029c8d-e5fd-4871-a9aa-5bcbf4a7221f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:23.541246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-0e029c8d-e5fd-4871-a9aa-5bcbf4a7221f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:23.542448 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-0e029c8d-e5fd-4871-a9aa-5bcbf4a7221f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1281 microversion: 2.20 time: 0.068477 Jun 27 15:31:23.543177 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 304/618] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:23 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:23.546929 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9372015e-8efb-41a6-872b-51aa4c025106 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:23.547647 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9372015e-8efb-41a6-872b-51aa4c025106 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:23.555005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9372015e-8efb-41a6-872b-51aa4c025106 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:23.555457 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9372015e-8efb-41a6-872b-51aa4c025106 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:23.556225 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9372015e-8efb-41a6-872b-51aa4c025106 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:23.556691 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9372015e-8efb-41a6-872b-51aa4c025106 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:23.697598 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9372015e-8efb-41a6-872b-51aa4c025106 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:23.705350 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9372015e-8efb-41a6-872b-51aa4c025106 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1681 microversion: 2.1 time: 0.162425 Jun 27 15:31:23.705909 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 315/619] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:23 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:24.314636 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-53e8ecab-06fc-4781-9701-6f246c8aa2e4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:24.315280 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-53e8ecab-06fc-4781-9701-6f246c8aa2e4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:24.323204 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-53e8ecab-06fc-4781-9701-6f246c8aa2e4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:24.323652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-53e8ecab-06fc-4781-9701-6f246c8aa2e4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:24.324472 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-53e8ecab-06fc-4781-9701-6f246c8aa2e4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:24.324951 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-53e8ecab-06fc-4781-9701-6f246c8aa2e4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:24.496120 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-53e8ecab-06fc-4781-9701-6f246c8aa2e4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:24.505013 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-53e8ecab-06fc-4781-9701-6f246c8aa2e4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1755 microversion: 2.1 time: 0.194363 Jun 27 15:31:24.505597 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 305/620] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:24 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1755 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:24.561252 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c717b0b9-ba41-4100-b0cb-c9d93c511d5b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:24.561871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c717b0b9-ba41-4100-b0cb-c9d93c511d5b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:24.569548 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c717b0b9-ba41-4100-b0cb-c9d93c511d5b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:24.569911 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c717b0b9-ba41-4100-b0cb-c9d93c511d5b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:24.570687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c717b0b9-ba41-4100-b0cb-c9d93c511d5b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:24.571120 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c717b0b9-ba41-4100-b0cb-c9d93c511d5b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:24.670059 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c717b0b9-ba41-4100-b0cb-c9d93c511d5b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:24.679187 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c717b0b9-ba41-4100-b0cb-c9d93c511d5b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:24.681009 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c717b0b9-ba41-4100-b0cb-c9d93c511d5b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:24.682501 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c717b0b9-ba41-4100-b0cb-c9d93c511d5b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1277 microversion: 2.20 time: 0.125541 Jun 27 15:31:24.684007 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 316/621] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:24 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1277 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:24.734012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-186904d2-5d63-4f54-a4da-3230feed9a91 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:24.736592 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-186904d2-5d63-4f54-a4da-3230feed9a91 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:24.749101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-186904d2-5d63-4f54-a4da-3230feed9a91 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:24.750509 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-186904d2-5d63-4f54-a4da-3230feed9a91 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:24.752205 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-186904d2-5d63-4f54-a4da-3230feed9a91 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:24.753037 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-186904d2-5d63-4f54-a4da-3230feed9a91 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:24.995448 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-186904d2-5d63-4f54-a4da-3230feed9a91 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:25.008476 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-186904d2-5d63-4f54-a4da-3230feed9a91 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1681 microversion: 2.1 time: 0.287748 Jun 27 15:31:25.025243 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 306/622] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:24 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1681 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:25.522898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ad069a21-32ec-4361-bee5-d17823203d5e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:25.524228 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ad069a21-32ec-4361-bee5-d17823203d5e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:25.533485 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad069a21-32ec-4361-bee5-d17823203d5e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:25.534011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad069a21-32ec-4361-bee5-d17823203d5e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:25.535082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad069a21-32ec-4361-bee5-d17823203d5e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:25.535770 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad069a21-32ec-4361-bee5-d17823203d5e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:25.707862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ad069a21-32ec-4361-bee5-d17823203d5e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:25.709500 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e121773f-c8ab-424e-b0dd-d56cc1351824 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:25.710087 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e121773f-c8ab-424e-b0dd-d56cc1351824 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:25.716680 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e121773f-c8ab-424e-b0dd-d56cc1351824 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:25.717272 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ad069a21-32ec-4361-bee5-d17823203d5e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1758 microversion: 2.1 time: 0.199488 Jun 27 15:31:25.717673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e121773f-c8ab-424e-b0dd-d56cc1351824 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:25.717858 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 317/623] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:25 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1758 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:25.718776 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e121773f-c8ab-424e-b0dd-d56cc1351824 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:25.719373 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e121773f-c8ab-424e-b0dd-d56cc1351824 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:25.801612 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e121773f-c8ab-424e-b0dd-d56cc1351824 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:25.810657 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e121773f-c8ab-424e-b0dd-d56cc1351824 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:25.812226 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e121773f-c8ab-424e-b0dd-d56cc1351824 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:25.814015 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e121773f-c8ab-424e-b0dd-d56cc1351824 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1339 microversion: 2.20 time: 0.108455 Jun 27 15:31:25.814958 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 307/624] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:25 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1339 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:31:25.918223 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-99d79cf9-1b62-4479-8960-9ed978cfd70a req-54842b78-06b2-4792-85d4-1d133c0162c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b669df6d-2c11-4910-bdc8-0eb82915b879", "name": "network-vif-deleted", "tag": "6903c7d7-bfc1-4974-9767-47e90c255031"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:25.942057 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-99d79cf9-1b62-4479-8960-9ed978cfd70a req-54842b78-06b2-4792-85d4-1d133c0162c2 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:25.942508 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-99d79cf9-1b62-4479-8960-9ed978cfd70a req-54842b78-06b2-4792-85d4-1d133c0162c2 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:25.959164 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-016163fc-b2d3-4db5-93aa-8375d2371aa1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:25.960729 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-016163fc-b2d3-4db5-93aa-8375d2371aa1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:25.975957 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-016163fc-b2d3-4db5-93aa-8375d2371aa1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:25.978025 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-016163fc-b2d3-4db5-93aa-8375d2371aa1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:25.979090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-016163fc-b2d3-4db5-93aa-8375d2371aa1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:25.981304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-016163fc-b2d3-4db5-93aa-8375d2371aa1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:25.988010 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-99d79cf9-1b62-4479-8960-9ed978cfd70a req-54842b78-06b2-4792-85d4-1d133c0162c2 service nova] Creating event network-vif-deleted:6903c7d7-bfc1-4974-9767-47e90c255031 for instance b669df6d-2c11-4910-bdc8-0eb82915b879 on hv-cinder-84779 Jun 27 15:31:26.002826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-99d79cf9-1b62-4479-8960-9ed978cfd70a req-54842b78-06b2-4792-85d4-1d133c0162c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090475 Jun 27 15:31:26.004230 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 318/625] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:26.039741 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:26.040950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:26.056204 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-016163fc-b2d3-4db5-93aa-8375d2371aa1 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.091091 Jun 27 15:31:26.064569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 308/626] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:25 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d/os-volume_attachments => generated 25 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:31:26.079944 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:26.084191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:26.086408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:26.086882 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:26.159778 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7a8f2cb1-c13e-49b3-bbcf-b8e2bec46d9a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:26.160683 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7a8f2cb1-c13e-49b3-bbcf-b8e2bec46d9a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:26.176745 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:26.177380 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7a8f2cb1-c13e-49b3-bbcf-b8e2bec46d9a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:26.177718 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:26.177975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7a8f2cb1-c13e-49b3-bbcf-b8e2bec46d9a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:26.178559 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lazy-loading 'fault' on Instance uuid b669df6d-2c11-4910-bdc8-0eb82915b879 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:26.178899 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7a8f2cb1-c13e-49b3-bbcf-b8e2bec46d9a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:26.179422 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7a8f2cb1-c13e-49b3-bbcf-b8e2bec46d9a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:26.233586 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7a8f2cb1-c13e-49b3-bbcf-b8e2bec46d9a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Going to try to terminate instance {{(pid=117977) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:31:26.239637 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:26.250322 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-47f4f1d7-b89f-48bc-ab31-fdcb798c567d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1332 microversion: 2.1 time: 0.218267 Jun 27 15:31:26.251912 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 319/627] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:26 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1332 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:26.345037 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7a8f2cb1-c13e-49b3-bbcf-b8e2bec46d9a tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 204 len: 0 microversion: 2.1 time: 0.189147 Jun 27 15:31:26.345635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 309/628] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:31:26 2022] DELETE /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:31:26.354351 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3d100d7a-dbe5-47b0-8b85-b92711fdc3ea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:26.354856 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3d100d7a-dbe5-47b0-8b85-b92711fdc3ea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:26.361295 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d100d7a-dbe5-47b0-8b85-b92711fdc3ea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:26.361862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d100d7a-dbe5-47b0-8b85-b92711fdc3ea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:26.362712 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d100d7a-dbe5-47b0-8b85-b92711fdc3ea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:26.363240 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d100d7a-dbe5-47b0-8b85-b92711fdc3ea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:26.511776 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3d100d7a-dbe5-47b0-8b85-b92711fdc3ea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:26.520997 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3d100d7a-dbe5-47b0-8b85-b92711fdc3ea tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1671 microversion: 2.1 time: 0.170835 Jun 27 15:31:26.521902 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 320/629] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:26 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1671 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:26.833992 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e6f43845-555f-4e9a-8113-77345d5713e8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:26.835774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e6f43845-555f-4e9a-8113-77345d5713e8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:26.850417 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e6f43845-555f-4e9a-8113-77345d5713e8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:26.851185 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e6f43845-555f-4e9a-8113-77345d5713e8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:26.852216 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e6f43845-555f-4e9a-8113-77345d5713e8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:26.853061 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e6f43845-555f-4e9a-8113-77345d5713e8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:27.016599 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e6f43845-555f-4e9a-8113-77345d5713e8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:27.020165 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:27.034353 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e6f43845-555f-4e9a-8113-77345d5713e8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:27.035915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e6f43845-555f-4e9a-8113-77345d5713e8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:27.037093 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e6f43845-555f-4e9a-8113-77345d5713e8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.207592 Jun 27 15:31:27.037652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 310/630] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:26 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:27.269394 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:27.270029 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:27.277361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:27.277852 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:27.278638 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:27.279047 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:27.318585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:27.319024 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:27.319480 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lazy-loading 'fault' on Instance uuid b669df6d-2c11-4910-bdc8-0eb82915b879 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:27.372423 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:27.380145 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4c17fd4a-8605-4ce2-b015-ea1acf7afc35 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1332 microversion: 2.1 time: 0.115086 Jun 27 15:31:27.380766 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 321/631] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:27 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1332 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:27.539035 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-02f0b771-2eef-4733-9b26-f3c2b6ae5cb3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:27.539642 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-02f0b771-2eef-4733-9b26-f3c2b6ae5cb3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:27.548083 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-02f0b771-2eef-4733-9b26-f3c2b6ae5cb3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:27.548623 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-02f0b771-2eef-4733-9b26-f3c2b6ae5cb3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:27.549810 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-02f0b771-2eef-4733-9b26-f3c2b6ae5cb3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:27.550250 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-02f0b771-2eef-4733-9b26-f3c2b6ae5cb3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:27.694324 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-02f0b771-2eef-4733-9b26-f3c2b6ae5cb3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:27.702500 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-02f0b771-2eef-4733-9b26-f3c2b6ae5cb3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1671 microversion: 2.1 time: 0.167425 Jun 27 15:31:27.703171 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 311/632] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:27 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:28.055729 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b3cd6e27-09bc-4169-abd6-c98f6c4e5003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:28.056352 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b3cd6e27-09bc-4169-abd6-c98f6c4e5003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:28.063830 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3cd6e27-09bc-4169-abd6-c98f6c4e5003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:28.064293 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3cd6e27-09bc-4169-abd6-c98f6c4e5003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:28.065108 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3cd6e27-09bc-4169-abd6-c98f6c4e5003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:28.065544 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3cd6e27-09bc-4169-abd6-c98f6c4e5003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:28.206586 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b3cd6e27-09bc-4169-abd6-c98f6c4e5003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:28.215222 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b3cd6e27-09bc-4169-abd6-c98f6c4e5003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:28.216861 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b3cd6e27-09bc-4169-abd6-c98f6c4e5003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:28.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b3cd6e27-09bc-4169-abd6-c98f6c4e5003 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.166310 Jun 27 15:31:28.218975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 322/633] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:28 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:28.397824 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:28.398475 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:28.405981 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:28.406375 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:28.407154 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:28.407586 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:28.443020 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:28.443472 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:28.443931 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lazy-loading 'fault' on Instance uuid b669df6d-2c11-4910-bdc8-0eb82915b879 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:28.490052 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:28.497950 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2bc059b9-9188-43a6-88e1-f70c96959458 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 200 len: 1332 microversion: 2.1 time: 0.104075 Jun 27 15:31:28.498528 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 312/634] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:28 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 1332 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:28.721246 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d6df90b7-1b25-4fb4-ab95-fc865b2a2753 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:28.722037 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d6df90b7-1b25-4fb4-ab95-fc865b2a2753 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:28.729424 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d6df90b7-1b25-4fb4-ab95-fc865b2a2753 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:28.729985 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d6df90b7-1b25-4fb4-ab95-fc865b2a2753 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:28.730782 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d6df90b7-1b25-4fb4-ab95-fc865b2a2753 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:28.731224 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d6df90b7-1b25-4fb4-ab95-fc865b2a2753 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:28.872688 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d6df90b7-1b25-4fb4-ab95-fc865b2a2753 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:28.881061 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d6df90b7-1b25-4fb4-ab95-fc865b2a2753 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1671 microversion: 2.1 time: 0.164406 Jun 27 15:31:28.881909 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 323/635] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:28 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1671 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:29.241041 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e3e34345-d453-49d8-b6d4-454a7985bfc3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:29.244390 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e3e34345-d453-49d8-b6d4-454a7985bfc3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:29.267212 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e3e34345-d453-49d8-b6d4-454a7985bfc3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:29.269450 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e3e34345-d453-49d8-b6d4-454a7985bfc3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:29.272480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e3e34345-d453-49d8-b6d4-454a7985bfc3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:29.275117 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e3e34345-d453-49d8-b6d4-454a7985bfc3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:29.516275 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7964b171-eb4e-4b15-a826-059ab47a1973 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:29.517119 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7964b171-eb4e-4b15-a826-059ab47a1973 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:29.523818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7964b171-eb4e-4b15-a826-059ab47a1973 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:29.524276 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7964b171-eb4e-4b15-a826-059ab47a1973 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:29.525091 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7964b171-eb4e-4b15-a826-059ab47a1973 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:29.525528 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7964b171-eb4e-4b15-a826-059ab47a1973 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:29.530090 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:29.544707 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-7964b171-eb4e-4b15-a826-059ab47a1973 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7964b171-eb4e-4b15-a826-059ab47a1973 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 HTTP/1.1 Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:31:29.546489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:31:29.548064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': 'b669df6d-2c11-4910-bdc8-0eb82915b879'} Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:31:29.548983 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:31:29.550402 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:29.552450 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7964b171-eb4e-4b15-a826-059ab47a1973 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:31:29.553013 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7964b171-eb4e-4b15-a826-059ab47a1973 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 404 len: 111 microversion: 2.1 time: 0.040905 Jun 27 15:31:29.553265 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 324/636] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:29 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:31:29.563837 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-960203d9-a611-4629-84cb-94705802308b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '.version_select at 0x7fb2734f5e50>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:29.590715 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-960203d9-a611-4629-84cb-94705802308b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961411220" status: 202 len: 0 microversion: 2.1 time: 0.031654 Jun 27 15:31:29.591303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 325/637] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jun 27 15:31:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961411220 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:31:29.698036 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-59a8f8a4-b5f5-4edd-9307-0438df0738d9 req-dba2d836-b2d8-474a-9fba-bf0814913cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886a9b39-9d64-4359-8d03-b07dbe1abf9c", "tag": "82ee23e2-cf54-4c80-aa3a-825aa5c81193"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:29.716401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-59a8f8a4-b5f5-4edd-9307-0438df0738d9 req-dba2d836-b2d8-474a-9fba-bf0814913cbc service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:29.717093 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-59a8f8a4-b5f5-4edd-9307-0438df0738d9 req-dba2d836-b2d8-474a-9fba-bf0814913cbc service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:29.722296 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e3e34345-d453-49d8-b6d4-454a7985bfc3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:29.731257 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-59a8f8a4-b5f5-4edd-9307-0438df0738d9 req-dba2d836-b2d8-474a-9fba-bf0814913cbc service nova] Creating event network-changed:82ee23e2-cf54-4c80-aa3a-825aa5c81193 for instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c on hv-cinder-84779 Jun 27 15:31:29.733802 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e3e34345-d453-49d8-b6d4-454a7985bfc3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:29.739775 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e3e34345-d453-49d8-b6d4-454a7985bfc3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:29.741040 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e3e34345-d453-49d8-b6d4-454a7985bfc3 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.507625 Jun 27 15:31:29.741624 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 313/638] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:29 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:31:29.742329 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-59a8f8a4-b5f5-4edd-9307-0438df0738d9 req-dba2d836-b2d8-474a-9fba-bf0814913cbc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049306 Jun 27 15:31:29.743830 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 326/639] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:29.899217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1059a250-c7c2-4555-8fe1-01144ece98c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:29.899833 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-1059a250-c7c2-4555-8fe1-01144ece98c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:29.914353 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1059a250-c7c2-4555-8fe1-01144ece98c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:29.916098 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1059a250-c7c2-4555-8fe1-01144ece98c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:29.916968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1059a250-c7c2-4555-8fe1-01144ece98c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:29.918054 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1059a250-c7c2-4555-8fe1-01144ece98c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:30.264068 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1059a250-c7c2-4555-8fe1-01144ece98c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:30.302136 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-1059a250-c7c2-4555-8fe1-01144ece98c2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1671 microversion: 2.1 time: 0.406507 Jun 27 15:31:30.303029 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 314/640] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:29 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1671 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:30.439431 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1ee5a16b-01d4-4786-a6df-d1eadd8e43fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:30.440518 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1ee5a16b-01d4-4786-a6df-d1eadd8e43fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:30.447808 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ee5a16b-01d4-4786-a6df-d1eadd8e43fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:30.448363 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ee5a16b-01d4-4786-a6df-d1eadd8e43fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:30.449230 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ee5a16b-01d4-4786-a6df-d1eadd8e43fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:30.449736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1ee5a16b-01d4-4786-a6df-d1eadd8e43fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:30.563476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-1ee5a16b-01d4-4786-a6df-d1eadd8e43fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lazy-loading 'services' on Instance uuid 598844cf-f73b-4630-ad12-f08ab67e89e3 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:30.658242 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1ee5a16b-01d4-4786-a6df-d1eadd8e43fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments/3fdf0667-b5ba-4255-96b3-a97fcb765b67" status: 202 len: 0 microversion: 2.1 time: 0.223246 Jun 27 15:31:30.659557 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 327/641] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:31:30 2022] DELETE /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments/3fdf0667-b5ba-4255-96b3-a97fcb765b67 => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:31:30.669883 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-99a96af5-c05f-46e7-8e86-8fe458c56489 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:30.671280 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-99a96af5-c05f-46e7-8e86-8fe458c56489 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:30.678826 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-99a96af5-c05f-46e7-8e86-8fe458c56489 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:30.679840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-99a96af5-c05f-46e7-8e86-8fe458c56489 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:30.681295 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-99a96af5-c05f-46e7-8e86-8fe458c56489 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:30.682173 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-99a96af5-c05f-46e7-8e86-8fe458c56489 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:30.738581 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-99a96af5-c05f-46e7-8e86-8fe458c56489 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073317 Jun 27 15:31:30.739490 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 315/642] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:30 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:30.764228 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6919c3e1-30ea-452c-9a6d-726aefe98819 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:30.766243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6919c3e1-30ea-452c-9a6d-726aefe98819 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:30.774234 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6919c3e1-30ea-452c-9a6d-726aefe98819 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:30.774770 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6919c3e1-30ea-452c-9a6d-726aefe98819 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:30.775742 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6919c3e1-30ea-452c-9a6d-726aefe98819 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:30.776441 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6919c3e1-30ea-452c-9a6d-726aefe98819 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:30.949570 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6919c3e1-30ea-452c-9a6d-726aefe98819 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:30.960141 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6919c3e1-30ea-452c-9a6d-726aefe98819 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:30.961824 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6919c3e1-30ea-452c-9a6d-726aefe98819 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:30.963066 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6919c3e1-30ea-452c-9a6d-726aefe98819 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.204906 Jun 27 15:31:30.963814 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 328/643] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:30 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:31.327239 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-12e97e4a-10be-4518-b6dd-50574a89d74f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:31.328289 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-12e97e4a-10be-4518-b6dd-50574a89d74f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:31.330832 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:31.336591 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-12e97e4a-10be-4518-b6dd-50574a89d74f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:31.337045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-12e97e4a-10be-4518-b6dd-50574a89d74f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:31.337838 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-12e97e4a-10be-4518-b6dd-50574a89d74f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:31.338270 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-12e97e4a-10be-4518-b6dd-50574a89d74f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:31.421182 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-12e97e4a-10be-4518-b6dd-50574a89d74f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:31.434642 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-12e97e4a-10be-4518-b6dd-50574a89d74f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1604 microversion: 2.1 time: 0.111614 Jun 27 15:31:31.436260 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 316/644] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:31 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1604 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:31.750497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a780e08f-f361-439c-8580-d98118979552 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:31.751512 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a780e08f-f361-439c-8580-d98118979552 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:31.758082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a780e08f-f361-439c-8580-d98118979552 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:31.758565 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a780e08f-f361-439c-8580-d98118979552 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:31.759313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a780e08f-f361-439c-8580-d98118979552 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:31.759775 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a780e08f-f361-439c-8580-d98118979552 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:31.777221 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-14dcac6d-5c0f-412f-8669-0db4963892e8 req-0edf9318-0946-47eb-85ba-88b1c411a7c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "53705ab2-462b-4198-8565-c1ad2fbf535d", "name": "network-vif-deleted", "tag": "309f419d-b0d1-4868-a4ca-ca1976451588"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:31.790346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-14dcac6d-5c0f-412f-8669-0db4963892e8 req-0edf9318-0946-47eb-85ba-88b1c411a7c0 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:31.791344 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-14dcac6d-5c0f-412f-8669-0db4963892e8 req-0edf9318-0946-47eb-85ba-88b1c411a7c0 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:31.793877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a780e08f-f361-439c-8580-d98118979552 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047465 Jun 27 15:31:31.794549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 329/645] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:31 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:31.805277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-14dcac6d-5c0f-412f-8669-0db4963892e8 req-0edf9318-0946-47eb-85ba-88b1c411a7c0 service nova] Creating event network-vif-deleted:309f419d-b0d1-4868-a4ca-ca1976451588 for instance 53705ab2-462b-4198-8565-c1ad2fbf535d on hv-cinder-84779 Jun 27 15:31:31.810885 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-14dcac6d-5c0f-412f-8669-0db4963892e8 req-0edf9318-0946-47eb-85ba-88b1c411a7c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038741 Jun 27 15:31:31.811679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 317/646] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:31.982016 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-caededf2-529c-4a94-83d1-3395542e81fb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:31.983098 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-caededf2-529c-4a94-83d1-3395542e81fb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:31.992556 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-caededf2-529c-4a94-83d1-3395542e81fb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:31.993049 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-caededf2-529c-4a94-83d1-3395542e81fb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:31.994152 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-caededf2-529c-4a94-83d1-3395542e81fb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:31.994692 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-caededf2-529c-4a94-83d1-3395542e81fb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:32.140257 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-caededf2-529c-4a94-83d1-3395542e81fb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:32.149116 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-caededf2-529c-4a94-83d1-3395542e81fb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:32.150621 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-caededf2-529c-4a94-83d1-3395542e81fb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:32.151753 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-caededf2-529c-4a94-83d1-3395542e81fb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.173710 Jun 27 15:31:32.152285 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 330/647] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:31 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:32.460004 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9d57c4f0-c489-4418-8f58-6444c44c17e3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:32.460640 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9d57c4f0-c489-4418-8f58-6444c44c17e3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:32.467451 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d57c4f0-c489-4418-8f58-6444c44c17e3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:32.467891 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d57c4f0-c489-4418-8f58-6444c44c17e3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:32.468888 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d57c4f0-c489-4418-8f58-6444c44c17e3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:32.469320 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d57c4f0-c489-4418-8f58-6444c44c17e3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:32.541858 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9d57c4f0-c489-4418-8f58-6444c44c17e3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:32.549721 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9d57c4f0-c489-4418-8f58-6444c44c17e3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1604 microversion: 2.1 time: 0.094103 Jun 27 15:31:32.550273 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 318/648] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:32 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1604 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:32.806903 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3d529b50-04ee-445d-99ae-e51b9014aa7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:32.807859 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3d529b50-04ee-445d-99ae-e51b9014aa7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:32.815414 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d529b50-04ee-445d-99ae-e51b9014aa7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:32.815969 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d529b50-04ee-445d-99ae-e51b9014aa7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:32.816665 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d529b50-04ee-445d-99ae-e51b9014aa7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:32.817097 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3d529b50-04ee-445d-99ae-e51b9014aa7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:32.849273 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3d529b50-04ee-445d-99ae-e51b9014aa7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047046 Jun 27 15:31:32.849912 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 331/649] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:32 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:33.170023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-cc27a254-ea2b-48e7-bea9-04e4b9bd89d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:33.170644 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-cc27a254-ea2b-48e7-bea9-04e4b9bd89d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:33.178146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc27a254-ea2b-48e7-bea9-04e4b9bd89d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:33.178595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc27a254-ea2b-48e7-bea9-04e4b9bd89d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:33.179366 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc27a254-ea2b-48e7-bea9-04e4b9bd89d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:33.179798 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cc27a254-ea2b-48e7-bea9-04e4b9bd89d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:33.320689 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-cc27a254-ea2b-48e7-bea9-04e4b9bd89d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:33.330707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-cc27a254-ea2b-48e7-bea9-04e4b9bd89d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:33.332205 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-cc27a254-ea2b-48e7-bea9-04e4b9bd89d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:33.333360 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-cc27a254-ea2b-48e7-bea9-04e4b9bd89d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.167401 Jun 27 15:31:33.333949 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 319/650] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:33 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:33.568702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7be9f25a-3bab-449c-aaf1-fd379bf98fb4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:33.569310 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7be9f25a-3bab-449c-aaf1-fd379bf98fb4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:33.571361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:33.571974 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:33.578032 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7be9f25a-3bab-449c-aaf1-fd379bf98fb4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:33.578476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7be9f25a-3bab-449c-aaf1-fd379bf98fb4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:33.579296 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7be9f25a-3bab-449c-aaf1-fd379bf98fb4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:33.579729 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7be9f25a-3bab-449c-aaf1-fd379bf98fb4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:33.648385 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7be9f25a-3bab-449c-aaf1-fd379bf98fb4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:33.659628 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7be9f25a-3bab-449c-aaf1-fd379bf98fb4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1604 microversion: 2.1 time: 0.094998 Jun 27 15:31:33.660197 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 332/651] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:33 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1604 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:33.863422 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-af6c36ae-e52e-48fb-83ab-66bb724f5b04 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:33.864451 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-af6c36ae-e52e-48fb-83ab-66bb724f5b04 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:33.866740 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=6 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:33.872641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-af6c36ae-e52e-48fb-83ab-66bb724f5b04 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:33.873061 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-af6c36ae-e52e-48fb-83ab-66bb724f5b04 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:33.873867 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-af6c36ae-e52e-48fb-83ab-66bb724f5b04 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:33.874281 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-af6c36ae-e52e-48fb-83ab-66bb724f5b04 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:33.906433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-af6c36ae-e52e-48fb-83ab-66bb724f5b04 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047412 Jun 27 15:31:33.907213 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 320/652] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:33 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:34.352001 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b708a09f-fb74-42bd-afdc-1d928045db77 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:34.352779 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b708a09f-fb74-42bd-afdc-1d928045db77 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:34.359640 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b708a09f-fb74-42bd-afdc-1d928045db77 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:34.360092 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b708a09f-fb74-42bd-afdc-1d928045db77 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:34.360915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b708a09f-fb74-42bd-afdc-1d928045db77 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:34.361357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b708a09f-fb74-42bd-afdc-1d928045db77 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:34.497252 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b708a09f-fb74-42bd-afdc-1d928045db77 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:34.506222 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b708a09f-fb74-42bd-afdc-1d928045db77 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:34.507710 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b708a09f-fb74-42bd-afdc-1d928045db77 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:34.508866 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b708a09f-fb74-42bd-afdc-1d928045db77 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.160933 Jun 27 15:31:34.509432 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 333/653] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:34 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:34.678298 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9b3e0518-2e4d-4ead-884e-159983b2d7b3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:34.679114 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9b3e0518-2e4d-4ead-884e-159983b2d7b3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:34.686135 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b3e0518-2e4d-4ead-884e-159983b2d7b3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:34.686595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b3e0518-2e4d-4ead-884e-159983b2d7b3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:34.687370 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b3e0518-2e4d-4ead-884e-159983b2d7b3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:34.687804 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9b3e0518-2e4d-4ead-884e-159983b2d7b3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:34.756619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9b3e0518-2e4d-4ead-884e-159983b2d7b3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:34.764611 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9b3e0518-2e4d-4ead-884e-159983b2d7b3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1321 microversion: 2.1 time: 0.090461 Jun 27 15:31:34.765183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 321/654] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:34 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1321 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:34.918354 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7baab083-2853-4bbb-8800-50c7fab287cb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:34.919383 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7baab083-2853-4bbb-8800-50c7fab287cb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:34.927049 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7baab083-2853-4bbb-8800-50c7fab287cb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:34.927515 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7baab083-2853-4bbb-8800-50c7fab287cb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:34.928287 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7baab083-2853-4bbb-8800-50c7fab287cb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:34.928800 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7baab083-2853-4bbb-8800-50c7fab287cb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:34.996817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7baab083-2853-4bbb-8800-50c7fab287cb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.081889 Jun 27 15:31:34.998783 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 334/655] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:34 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments => generated 197 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:35.528031 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-009e877e-f7a2-4c04-ba55-78db3b8eaf08 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:35.528991 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-009e877e-f7a2-4c04-ba55-78db3b8eaf08 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:35.537641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-009e877e-f7a2-4c04-ba55-78db3b8eaf08 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:35.538131 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-009e877e-f7a2-4c04-ba55-78db3b8eaf08 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:35.538944 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-009e877e-f7a2-4c04-ba55-78db3b8eaf08 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:35.539414 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-009e877e-f7a2-4c04-ba55-78db3b8eaf08 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:35.688885 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-009e877e-f7a2-4c04-ba55-78db3b8eaf08 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:35.699848 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-009e877e-f7a2-4c04-ba55-78db3b8eaf08 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:35.701363 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-009e877e-f7a2-4c04-ba55-78db3b8eaf08 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:35.702481 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-009e877e-f7a2-4c04-ba55-78db3b8eaf08 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.179799 Jun 27 15:31:35.703050 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 322/656] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:35 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:35.785383 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:35.785956 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:35.792867 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:35.793325 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:35.794108 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:35.794545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:35.834009 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:35.834465 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:35.834930 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lazy-loading 'fault' on Instance uuid 53705ab2-462b-4198-8565-c1ad2fbf535d {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:35.882596 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:35.894894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-efe2fa04-c2ee-4378-bbfd-6fae0c5b34ec tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1326 microversion: 2.1 time: 0.113772 Jun 27 15:31:35.895535 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 335/657] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:35 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1326 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:36.011079 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b4b575f3-9b0d-47e9-960f-561d55e3726e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:36.012170 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b4b575f3-9b0d-47e9-960f-561d55e3726e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:36.019677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b4b575f3-9b0d-47e9-960f-561d55e3726e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:36.020129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b4b575f3-9b0d-47e9-960f-561d55e3726e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:36.020964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b4b575f3-9b0d-47e9-960f-561d55e3726e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:36.021401 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b4b575f3-9b0d-47e9-960f-561d55e3726e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:36.057138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b4b575f3-9b0d-47e9-960f-561d55e3726e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050231 Jun 27 15:31:36.057623 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 323/658] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:36 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:36.728036 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c803c2e0-4af4-4075-8deb-21ab801f26dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:36.729291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c803c2e0-4af4-4075-8deb-21ab801f26dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:36.740298 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c803c2e0-4af4-4075-8deb-21ab801f26dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:36.741101 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c803c2e0-4af4-4075-8deb-21ab801f26dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:36.742468 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c803c2e0-4af4-4075-8deb-21ab801f26dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:36.743233 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c803c2e0-4af4-4075-8deb-21ab801f26dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:36.889596 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c803c2e0-4af4-4075-8deb-21ab801f26dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:36.899002 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c803c2e0-4af4-4075-8deb-21ab801f26dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:36.900522 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c803c2e0-4af4-4075-8deb-21ab801f26dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:36.901643 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c803c2e0-4af4-4075-8deb-21ab801f26dd tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.181485 Jun 27 15:31:36.902251 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 336/659] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:36 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:36.914446 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:36.915084 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:36.922522 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:36.922964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:36.923848 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:36.925222 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:36.959389 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:36.960473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:36.960473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lazy-loading 'fault' on Instance uuid 53705ab2-462b-4198-8565-c1ad2fbf535d {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:37.003022 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:37.010966 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b3124559-4ce3-4ff9-90ba-5ccf661ed425 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1326 microversion: 2.1 time: 0.100521 Jun 27 15:31:37.011541 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 324/660] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:36 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1326 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:31:37.071650 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fe0e08c3-d115-44ba-b3f9-6b189798a648 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:37.072736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fe0e08c3-d115-44ba-b3f9-6b189798a648 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:37.079716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe0e08c3-d115-44ba-b3f9-6b189798a648 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:37.080153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe0e08c3-d115-44ba-b3f9-6b189798a648 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:37.081408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe0e08c3-d115-44ba-b3f9-6b189798a648 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:37.081756 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fe0e08c3-d115-44ba-b3f9-6b189798a648 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:37.118014 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fe0e08c3-d115-44ba-b3f9-6b189798a648 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050307 Jun 27 15:31:37.118523 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 337/661] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:37 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:37.920882 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e92aa92b-d758-4fb0-92e6-d49743c2a66a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:37.921496 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e92aa92b-d758-4fb0-92e6-d49743c2a66a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:37.929321 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e92aa92b-d758-4fb0-92e6-d49743c2a66a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:37.929766 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e92aa92b-d758-4fb0-92e6-d49743c2a66a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:37.930543 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e92aa92b-d758-4fb0-92e6-d49743c2a66a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:37.930970 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e92aa92b-d758-4fb0-92e6-d49743c2a66a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:38.028901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:38.029558 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:38.037099 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:38.037645 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:38.038351 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:38.038769 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:38.075078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:38.075520 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:38.075989 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lazy-loading 'fault' on Instance uuid 53705ab2-462b-4198-8565-c1ad2fbf535d {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:38.111334 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e92aa92b-d758-4fb0-92e6-d49743c2a66a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:38.144725 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e92aa92b-d758-4fb0-92e6-d49743c2a66a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:38.148137 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e92aa92b-d758-4fb0-92e6-d49743c2a66a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:38.150886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e92aa92b-d758-4fb0-92e6-d49743c2a66a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.233405 Jun 27 15:31:38.152108 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 325/662] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:37 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:38.153579 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:38.163375 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1c92ab74-5582-467b-8ffa-4e932faee5d5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:38.165172 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-1c92ab74-5582-467b-8ffa-4e932faee5d5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:38.169389 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2fdee05c-17af-458c-9ed0-17e76589d482 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 200 len: 1326 microversion: 2.1 time: 0.144143 Jun 27 15:31:38.170018 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 338/663] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:38 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 1326 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:38.185824 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1c92ab74-5582-467b-8ffa-4e932faee5d5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:38.186643 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1c92ab74-5582-467b-8ffa-4e932faee5d5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:38.189143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1c92ab74-5582-467b-8ffa-4e932faee5d5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:38.190004 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1c92ab74-5582-467b-8ffa-4e932faee5d5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:38.261304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-1c92ab74-5582-467b-8ffa-4e932faee5d5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106277 Jun 27 15:31:38.264684 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 326/664] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:38 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments => generated 197 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:39.169645 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-13815f0a-274c-499d-ac6e-d373d7d62afe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:39.170320 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-13815f0a-274c-499d-ac6e-d373d7d62afe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:39.177980 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13815f0a-274c-499d-ac6e-d373d7d62afe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.178433 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13815f0a-274c-499d-ac6e-d373d7d62afe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.179232 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13815f0a-274c-499d-ac6e-d373d7d62afe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.179687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13815f0a-274c-499d-ac6e-d373d7d62afe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.187634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8582dac9-2c75-4235-9217-fddb2d0c4050 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:39.188287 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8582dac9-2c75-4235-9217-fddb2d0c4050 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:39.195659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8582dac9-2c75-4235-9217-fddb2d0c4050 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.196174 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8582dac9-2c75-4235-9217-fddb2d0c4050 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.197171 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8582dac9-2c75-4235-9217-fddb2d0c4050 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.197657 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8582dac9-2c75-4235-9217-fddb2d0c4050 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.213664 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-8582dac9-2c75-4235-9217-fddb2d0c4050 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] HTTP exception thrown: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8582dac9-2c75-4235-9217-fddb2d0c4050 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Request method failure captured: Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d HTTP/1.1 Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwyhrXvpCqPplKR8a98QVW12ooHNqCqz3XSZt4F1-ZWvgXF3_E0pDZdI1mpf1FP68Pt2IiSEj3mwGTFfKKSP6UuEMPBgq0a_li_vWxHfgwscJr-_9K5L_jGwrNrkYlIwdKmlfh79C7JTu_grOi_I79QkBbJRd7RLlkSFE7PpXtB-ig Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:31:39.215337 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e07fc46cd5f4afe875767c926bd63ee", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 995fa1760f5241588a493e5f894b0e3f Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:31:39.217246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '53705ab2-462b-4198-8565-c1ad2fbf535d'} Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:31:39.218046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:31:39.219371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:39.220666 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8582dac9-2c75-4235-9217-fddb2d0c4050 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Returning 404 to user: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:31:39.220666 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8582dac9-2c75-4235-9217-fddb2d0c4050 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 404 len: 111 microversion: 2.1 time: 0.033115 Jun 27 15:31:39.220666 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 327/665] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:39 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:31:39.226713 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f6617921-aaa1-4445-a72a-34dcf5e3e718 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '.version_select at 0x7fb273589670>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:39.248855 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f6617921-aaa1-4445-a72a-34dcf5e3e718 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657700173" status: 202 len: 0 microversion: 2.1 time: 0.026284 Jun 27 15:31:39.249692 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 328/666] 10.222.0.26 () {58 vars in 1217 bytes} [Mon Jun 27 15:31:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657700173 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:31:39.278382 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-69723a84-69ed-4228-82bc-b8b25ab0e54c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:39.279040 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-69723a84-69ed-4228-82bc-b8b25ab0e54c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:39.287796 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-69723a84-69ed-4228-82bc-b8b25ab0e54c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.288609 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-69723a84-69ed-4228-82bc-b8b25ab0e54c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.289106 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-69723a84-69ed-4228-82bc-b8b25ab0e54c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.289810 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-69723a84-69ed-4228-82bc-b8b25ab0e54c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.295366 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=100 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:39.325954 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-69723a84-69ed-4228-82bc-b8b25ab0e54c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052612 Jun 27 15:31:39.332670 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 329/667] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:39 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:31:39.362894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-13815f0a-274c-499d-ac6e-d373d7d62afe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:39.373590 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-13815f0a-274c-499d-ac6e-d373d7d62afe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:39.375129 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-13815f0a-274c-499d-ac6e-d373d7d62afe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:39.376362 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-13815f0a-274c-499d-ac6e-d373d7d62afe tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.210905 Jun 27 15:31:39.377906 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 339/668] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:39 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:39.416199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-41fa52f1-8db8-4935-a6ba-6b3857a6797c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:39.416915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-41fa52f1-8db8-4935-a6ba-6b3857a6797c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:39.423429 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41fa52f1-8db8-4935-a6ba-6b3857a6797c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.423840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41fa52f1-8db8-4935-a6ba-6b3857a6797c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.424863 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41fa52f1-8db8-4935-a6ba-6b3857a6797c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.425304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-41fa52f1-8db8-4935-a6ba-6b3857a6797c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.454767 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-41fa52f1-8db8-4935-a6ba-6b3857a6797c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Going to try to terminate instance {{(pid=117977) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:31:39.553473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-41fa52f1-8db8-4935-a6ba-6b3857a6797c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 204 len: 0 microversion: 2.1 time: 0.141544 Jun 27 15:31:39.555099 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 330/669] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:31:39 2022] DELETE /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:31:39.568922 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-32ca7789-bda2-41b4-99c8-c21956946431 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:39.569723 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-32ca7789-bda2-41b4-99c8-c21956946431 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:39.579391 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32ca7789-bda2-41b4-99c8-c21956946431 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.580101 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32ca7789-bda2-41b4-99c8-c21956946431 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.581549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32ca7789-bda2-41b4-99c8-c21956946431 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.582203 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32ca7789-bda2-41b4-99c8-c21956946431 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.827820 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-32ca7789-bda2-41b4-99c8-c21956946431 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:39.837815 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-32ca7789-bda2-41b4-99c8-c21956946431 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1681 microversion: 2.1 time: 0.277297 Jun 27 15:31:39.838771 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 340/670] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:39 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1681 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:39.923897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-ec940046-0edd-4e1b-8828-0d9a2bcf3a01 req-4c2d03f5-59eb-4d55-a1a0-604c090ab841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886a9b39-9d64-4359-8d03-b07dbe1abf9c", "name": "network-vif-plugged", "status": "completed", "tag": "82ee23e2-cf54-4c80-aa3a-825aa5c81193"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:39.946252 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-ec940046-0edd-4e1b-8828-0d9a2bcf3a01 req-4c2d03f5-59eb-4d55-a1a0-604c090ab841 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:39.946706 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-ec940046-0edd-4e1b-8828-0d9a2bcf3a01 req-4c2d03f5-59eb-4d55-a1a0-604c090ab841 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:39.964883 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-ec940046-0edd-4e1b-8828-0d9a2bcf3a01 req-4c2d03f5-59eb-4d55-a1a0-604c090ab841 service nova] Creating event network-vif-plugged:82ee23e2-cf54-4c80-aa3a-825aa5c81193 for instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c on hv-cinder-84779 Jun 27 15:31:39.970232 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-ec940046-0edd-4e1b-8828-0d9a2bcf3a01 req-4c2d03f5-59eb-4d55-a1a0-604c090ab841 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056201 Jun 27 15:31:39.971076 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 331/671] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:40.088001 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1ddb6c8c-774f-4611-9808-076e71a43ad3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'create', calling method: .version_select at 0x7fb2733c1670>, body: {"keypair": {"name": "tempest-keypair-1767533954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvfbz3i6y+qvBP4qWP1/x7VCQQV/FznbrI9uf6t+Eq9cg3tjRqLgEZv0ZgUqPNiel4BSLP5jK9kCC4GJXriNZUfj+HQwC0ENyMiuc3ter8CYh1OVNgMVdD0EzVMVNsamw=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:40.102961 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-1ddb6c8c-774f-4611-9808-076e71a43ad3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Getting quotas for project 2e07fc46cd5f4afe875767c926bd63ee. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:31:40.107336 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-1ddb6c8c-774f-4611-9808-076e71a43ad3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Getting quotas for user 995fa1760f5241588a493e5f894b0e3f and project 2e07fc46cd5f4afe875767c926bd63ee. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:31:40.132132 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1ddb6c8c-774f-4611-9808-076e71a43ad3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048032 Jun 27 15:31:40.132791 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 341/672] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jun 27 15:31:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:40.398649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4304278b-b28a-4fad-8539-90d5a08f6a46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:40.398649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4304278b-b28a-4fad-8539-90d5a08f6a46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:40.409598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4304278b-b28a-4fad-8539-90d5a08f6a46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:40.410314 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4304278b-b28a-4fad-8539-90d5a08f6a46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:40.412108 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4304278b-b28a-4fad-8539-90d5a08f6a46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:40.412861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4304278b-b28a-4fad-8539-90d5a08f6a46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:40.622798 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4304278b-b28a-4fad-8539-90d5a08f6a46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:40.631887 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4304278b-b28a-4fad-8539-90d5a08f6a46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:40.633420 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4304278b-b28a-4fad-8539-90d5a08f6a46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:40.634599 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4304278b-b28a-4fad-8539-90d5a08f6a46 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.242628 Jun 27 15:31:40.635171 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 332/673] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:40 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:40.860815 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5e4b4c14-d19a-42aa-9ee7-4c83edccade2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:40.862946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5e4b4c14-d19a-42aa-9ee7-4c83edccade2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:40.869305 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e4b4c14-d19a-42aa-9ee7-4c83edccade2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:40.869755 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e4b4c14-d19a-42aa-9ee7-4c83edccade2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:40.870530 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e4b4c14-d19a-42aa-9ee7-4c83edccade2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:40.870964 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e4b4c14-d19a-42aa-9ee7-4c83edccade2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:41.316630 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5e4b4c14-d19a-42aa-9ee7-4c83edccade2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:41.319188 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:41.327706 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5e4b4c14-d19a-42aa-9ee7-4c83edccade2 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1681 microversion: 2.1 time: 0.473131 Jun 27 15:31:41.330950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 342/674] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:40 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1681 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:41.654000 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5b59aac5-cdf2-449f-b2c1-4c21b536cdf0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:41.655126 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5b59aac5-cdf2-449f-b2c1-4c21b536cdf0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:41.662492 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b59aac5-cdf2-449f-b2c1-4c21b536cdf0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:41.662953 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b59aac5-cdf2-449f-b2c1-4c21b536cdf0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:41.663760 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b59aac5-cdf2-449f-b2c1-4c21b536cdf0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:41.664241 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b59aac5-cdf2-449f-b2c1-4c21b536cdf0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:41.831809 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b59aac5-cdf2-449f-b2c1-4c21b536cdf0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:41.843378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b59aac5-cdf2-449f-b2c1-4c21b536cdf0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:41.845001 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b59aac5-cdf2-449f-b2c1-4c21b536cdf0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:41.850198 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5b59aac5-cdf2-449f-b2c1-4c21b536cdf0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.196179 Jun 27 15:31:41.852213 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 333/675] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:41 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:41.973632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-519172342", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "42d6796f-0df3-4f1e-9bd2-00a387c5c9c3"}], "security_groups": [{"name": "tempest-securitygroup--1751140496"}], "key_name": "tempest-keypair-1767533954", "user_data": "}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:42.084607 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] validate_networks() for [('42d6796f-0df3-4f1e-9bd2-00a387c5c9c3', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:31:42.348080 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-14ef24c6-ea9f-451b-9b7f-67fe522e2841 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:42.348912 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-14ef24c6-ea9f-451b-9b7f-67fe522e2841 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:42.357199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-14ef24c6-ea9f-451b-9b7f-67fe522e2841 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:42.357704 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-14ef24c6-ea9f-451b-9b7f-67fe522e2841 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:42.358504 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-14ef24c6-ea9f-451b-9b7f-67fe522e2841 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:42.358935 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-14ef24c6-ea9f-451b-9b7f-67fe522e2841 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:42.458254 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-14ef24c6-ea9f-451b-9b7f-67fe522e2841 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:42.466655 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-14ef24c6-ea9f-451b-9b7f-67fe522e2841 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1613 microversion: 2.1 time: 0.123294 Jun 27 15:31:42.467250 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 334/676] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:42 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1613 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:42.551784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:31:42.552211 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:31:42.553291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:31:42.553291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:31:42.553511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:31:42.564067 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:42.564602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:42.565458 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:42.565899 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:42.585416 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Getting quotas for project 2e07fc46cd5f4afe875767c926bd63ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:31:42.589982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Getting quotas for user 995fa1760f5241588a493e5f894b0e3f and project 2e07fc46cd5f4afe875767c926bd63ee. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:31:42.602797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:31:42.605327 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:31:42.687151 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-42d314ca-572d-4551-9313-fa869d9b4a55 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:42.688046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-42d314ca-572d-4551-9313-fa869d9b4a55 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:42.691442 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-79eefa76-0f68-40d4-b153-c6ef530936a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.722063 Jun 27 15:31:42.701814 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-42d314ca-572d-4551-9313-fa869d9b4a55 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:42.702883 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-42d314ca-572d-4551-9313-fa869d9b4a55 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:42.704754 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-42d314ca-572d-4551-9313-fa869d9b4a55 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:42.707448 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-42d314ca-572d-4551-9313-fa869d9b4a55 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:42.718522 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 343/677] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:31:41 2022] POST /compute/v2.1/servers => generated 402 bytes in 750 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:31:42.730565 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cd5ab026-322e-45fe-86ae-f05a3200f980 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:42.731799 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cd5ab026-322e-45fe-86ae-f05a3200f980 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:42.735740 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:DELETE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:42.902533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cd5ab026-322e-45fe-86ae-f05a3200f980 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:42.912195 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cd5ab026-322e-45fe-86ae-f05a3200f980 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1237 microversion: 2.1 time: 0.191620 Jun 27 15:31:42.913101 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 344/678] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:42 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1237 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:42.923506 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-d521649b-9cb7-4d22-9ae5-584fa6337d0b req-e6cd7670-bcfb-4d9c-a61b-d508d4c03ecc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "598844cf-f73b-4630-ad12-f08ab67e89e3", "name": "network-vif-deleted", "tag": "209e6ff3-398f-4386-b25b-aef36d5f7e9c"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:42.936467 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d521649b-9cb7-4d22-9ae5-584fa6337d0b req-e6cd7670-bcfb-4d9c-a61b-d508d4c03ecc service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:42.939781 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d521649b-9cb7-4d22-9ae5-584fa6337d0b req-e6cd7670-bcfb-4d9c-a61b-d508d4c03ecc service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:42.967538 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-d521649b-9cb7-4d22-9ae5-584fa6337d0b req-e6cd7670-bcfb-4d9c-a61b-d508d4c03ecc service nova] Creating event network-vif-deleted:209e6ff3-398f-4386-b25b-aef36d5f7e9c for instance 598844cf-f73b-4630-ad12-f08ab67e89e3 on hv-cinder-84779 Jun 27 15:31:42.971611 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-42d314ca-572d-4551-9313-fa869d9b4a55 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lazy-loading 'services' on Instance uuid edb0650f-918c-45f5-8739-099eb50c3e9a {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:42.983777 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-d521649b-9cb7-4d22-9ae5-584fa6337d0b req-e6cd7670-bcfb-4d9c-a61b-d508d4c03ecc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064370 Jun 27 15:31:42.987854 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 345/679] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:42.994915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1a5969b1-407b-4207-be10-05a0820084c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:42.995647 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1a5969b1-407b-4207-be10-05a0820084c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:43.008663 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a5969b1-407b-4207-be10-05a0820084c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:43.009151 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a5969b1-407b-4207-be10-05a0820084c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:43.010114 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a5969b1-407b-4207-be10-05a0820084c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:43.011163 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1a5969b1-407b-4207-be10-05a0820084c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:43.107182 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-42d314ca-572d-4551-9313-fa869d9b4a55 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a/os-volume_attachments/e9820811-39a2-42c3-8b8e-b184ee069726" status: 202 len: 0 microversion: 2.1 time: 0.430076 Jun 27 15:31:43.107829 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 335/680] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:31:42 2022] DELETE /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a/os-volume_attachments/e9820811-39a2-42c3-8b8e-b184ee069726 => generated 0 bytes in 432 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:31:43.255837 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1a5969b1-407b-4207-be10-05a0820084c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:43.267109 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1a5969b1-407b-4207-be10-05a0820084c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:43.269653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1a5969b1-407b-4207-be10-05a0820084c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:43.271138 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1a5969b1-407b-4207-be10-05a0820084c9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1406 microversion: 2.20 time: 0.281941 Jun 27 15:31:43.271703 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 346/681] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:42 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1406 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:43.490702 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:43.491412 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:43.498091 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:43.498512 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:43.499291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:43.499754 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:43.534600 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:43.535035 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:43.535488 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lazy-loading 'fault' on Instance uuid 598844cf-f73b-4630-ad12-f08ab67e89e3 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:43.586264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:43.594606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-cf00e3b8-f2c6-4078-bf9a-f206886432c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 200 len: 1331 microversion: 2.1 time: 0.108646 Jun 27 15:31:43.595199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 336/682] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:43 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 1331 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:44.003654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7f1c7179-8768-438c-bc8d-9b0f00aba4a4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:44.004273 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7f1c7179-8768-438c-bc8d-9b0f00aba4a4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:44.013359 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f1c7179-8768-438c-bc8d-9b0f00aba4a4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:44.013823 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f1c7179-8768-438c-bc8d-9b0f00aba4a4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:44.014612 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f1c7179-8768-438c-bc8d-9b0f00aba4a4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:44.015340 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7f1c7179-8768-438c-bc8d-9b0f00aba4a4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:44.090747 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7f1c7179-8768-438c-bc8d-9b0f00aba4a4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:44.106242 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7f1c7179-8768-438c-bc8d-9b0f00aba4a4 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1233 microversion: 2.1 time: 0.170269 Jun 27 15:31:44.107508 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 347/683] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:43 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1233 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:44.386251 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-88289641-2d1a-415b-b7bf-fae67e0aafde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:44.386977 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-88289641-2d1a-415b-b7bf-fae67e0aafde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:44.393601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-88289641-2d1a-415b-b7bf-fae67e0aafde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:44.394048 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-88289641-2d1a-415b-b7bf-fae67e0aafde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:44.394817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-88289641-2d1a-415b-b7bf-fae67e0aafde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:44.395242 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-88289641-2d1a-415b-b7bf-fae67e0aafde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:44.541776 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-88289641-2d1a-415b-b7bf-fae67e0aafde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:44.551062 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-88289641-2d1a-415b-b7bf-fae67e0aafde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:44.552591 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-88289641-2d1a-415b-b7bf-fae67e0aafde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:44.553768 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-88289641-2d1a-415b-b7bf-fae67e0aafde tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1598 microversion: 2.20 time: 0.267965 Jun 27 15:31:44.554344 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 337/684] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:31:44 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1598 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:31:44.574772 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bdbc9adc-bca9-471c-b6e6-7783818280ef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:44.575344 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bdbc9adc-bca9-471c-b6e6-7783818280ef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:44.583097 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bdbc9adc-bca9-471c-b6e6-7783818280ef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:44.583627 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bdbc9adc-bca9-471c-b6e6-7783818280ef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:44.584706 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bdbc9adc-bca9-471c-b6e6-7783818280ef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:44.585578 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bdbc9adc-bca9-471c-b6e6-7783818280ef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:44.623189 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-be4af766-f77e-406e-b5c5-6ff73c0d51d1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:44.624363 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-be4af766-f77e-406e-b5c5-6ff73c0d51d1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:44.632893 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-be4af766-f77e-406e-b5c5-6ff73c0d51d1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:44.633748 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-be4af766-f77e-406e-b5c5-6ff73c0d51d1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:44.634754 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-be4af766-f77e-406e-b5c5-6ff73c0d51d1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:44.635582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-be4af766-f77e-406e-b5c5-6ff73c0d51d1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:44.652572 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-be4af766-f77e-406e-b5c5-6ff73c0d51d1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-be4af766-f77e-406e-b5c5-6ff73c0d51d1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 HTTP/1.1 Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:31:44.654671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:31:44.655972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '598844cf-f73b-4630-ad12-f08ab67e89e3'} Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:31:44.656752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:31:44.657892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:44.661668 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-be4af766-f77e-406e-b5c5-6ff73c0d51d1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:31:44.662917 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-be4af766-f77e-406e-b5c5-6ff73c0d51d1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 404 len: 111 microversion: 2.1 time: 0.043952 Jun 27 15:31:44.663802 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 338/685] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:44 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:31:44.674870 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-dd545376-65be-451f-abdd-8c6e701543ab tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '.version_select at 0x7fb2736058b0>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:44.699606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-dd545376-65be-451f-abdd-8c6e701543ab tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267634364" status: 202 len: 0 microversion: 2.1 time: 0.029636 Jun 27 15:31:44.701185 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 339/686] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jun 27 15:31:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1267634364 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:31:44.716968 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bdbc9adc-bca9-471c-b6e6-7783818280ef tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146733 Jun 27 15:31:44.717572 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 348/687] 10.222.0.26 () {60 vars in 1315 bytes} [Mon Jun 27 15:31:44 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:31:45.125399 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-73733c1d-0525-4554-9cdb-dd03bb22e7d3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:45.126255 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-73733c1d-0525-4554-9cdb-dd03bb22e7d3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:45.137768 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73733c1d-0525-4554-9cdb-dd03bb22e7d3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:45.137768 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73733c1d-0525-4554-9cdb-dd03bb22e7d3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:45.138873 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73733c1d-0525-4554-9cdb-dd03bb22e7d3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:45.139376 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-73733c1d-0525-4554-9cdb-dd03bb22e7d3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:45.222398 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-73733c1d-0525-4554-9cdb-dd03bb22e7d3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:45.241651 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-73733c1d-0525-4554-9cdb-dd03bb22e7d3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1295 microversion: 2.1 time: 0.120500 Jun 27 15:31:45.253380 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 340/688] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:45 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1295 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:45.328931 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b24b925b-c4be-4c62-8cff-0ed5709e8337 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:45.330061 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b24b925b-c4be-4c62-8cff-0ed5709e8337 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:45.337005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b24b925b-c4be-4c62-8cff-0ed5709e8337 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:45.337562 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b24b925b-c4be-4c62-8cff-0ed5709e8337 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:45.338430 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b24b925b-c4be-4c62-8cff-0ed5709e8337 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:45.338939 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b24b925b-c4be-4c62-8cff-0ed5709e8337 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:45.366711 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b24b925b-c4be-4c62-8cff-0ed5709e8337 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:31:45.479126 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b24b925b-c4be-4c62-8cff-0ed5709e8337 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "DELETE /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 204 len: 0 microversion: 2.1 time: 0.154580 Jun 27 15:31:45.480703 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 349/689] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:31:45 2022] DELETE /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:31:45.494756 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6d94a9e0-d54d-47ce-9fc4-0f0a5f800861 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:45.496185 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-6d94a9e0-d54d-47ce-9fc4-0f0a5f800861 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:45.504128 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d94a9e0-d54d-47ce-9fc4-0f0a5f800861 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:45.504991 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d94a9e0-d54d-47ce-9fc4-0f0a5f800861 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:45.506985 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d94a9e0-d54d-47ce-9fc4-0f0a5f800861 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:45.507430 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d94a9e0-d54d-47ce-9fc4-0f0a5f800861 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:45.734002 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6d94a9e0-d54d-47ce-9fc4-0f0a5f800861 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:45.746338 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-6d94a9e0-d54d-47ce-9fc4-0f0a5f800861 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1513 microversion: 2.1 time: 0.258330 Jun 27 15:31:45.747153 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 341/690] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:45 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1513 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:46.052004 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e0452200-1831-464a-bf19-8e9bb29111e1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: .version_select at 0x7fb2733c15e0>, body: {"keypair": {"name": "tempest-keypair-1827982800", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOTtfMFpjNxdYFYlklIdeYDglPpdbBlfmOIqfNTjSkMzMBFxrHuQah3totA9oGXYf2udSGHnSHVT5ZrcHppwbc0oS0vkH4635HeEpNmx33LJibDy9brWDDy/CWl2qVkAaA=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:46.070894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-e0452200-1831-464a-bf19-8e9bb29111e1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for project dff1983b1b3047378b88d87d54aa709d. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:31:46.075323 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-e0452200-1831-464a-bf19-8e9bb29111e1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for user 23abc809ab644c1da0270a35ac8bab21 and project dff1983b1b3047378b88d87d54aa709d. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:31:46.103157 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e0452200-1831-464a-bf19-8e9bb29111e1 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.055425 Jun 27 15:31:46.104213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 350/691] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jun 27 15:31:46 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:46.253386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-c1100211-2f73-4c7e-a727-059ef12821c7 req-2112834e-6840-4026-af57-e57930bd7f99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "886a9b39-9d64-4359-8d03-b07dbe1abf9c", "tag": "82ee23e2-cf54-4c80-aa3a-825aa5c81193"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:46.263432 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-be776ee8-390c-43cc-b704-3f74c05621a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:46.265784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-be776ee8-390c-43cc-b704-3f74c05621a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:46.274844 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be776ee8-390c-43cc-b704-3f74c05621a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:46.275701 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be776ee8-390c-43cc-b704-3f74c05621a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:46.276737 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be776ee8-390c-43cc-b704-3f74c05621a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:46.277448 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-be776ee8-390c-43cc-b704-3f74c05621a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:46.281482 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-c1100211-2f73-4c7e-a727-059ef12821c7 req-2112834e-6840-4026-af57-e57930bd7f99 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:46.282286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-c1100211-2f73-4c7e-a727-059ef12821c7 req-2112834e-6840-4026-af57-e57930bd7f99 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:46.309273 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-c1100211-2f73-4c7e-a727-059ef12821c7 req-2112834e-6840-4026-af57-e57930bd7f99 service nova] Creating event network-changed:82ee23e2-cf54-4c80-aa3a-825aa5c81193 for instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c on hv-cinder-84779 Jun 27 15:31:46.320244 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-c1100211-2f73-4c7e-a727-059ef12821c7 req-2112834e-6840-4026-af57-e57930bd7f99 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074152 Jun 27 15:31:46.322272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 342/692] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:46.462428 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-be776ee8-390c-43cc-b704-3f74c05621a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:46.471496 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-be776ee8-390c-43cc-b704-3f74c05621a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.213446 Jun 27 15:31:46.472248 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 351/693] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:46 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:46.767473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e7c2c044-eaa6-427c-a029-a75c49221d25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:46.769189 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e7c2c044-eaa6-427c-a029-a75c49221d25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:46.779042 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e7c2c044-eaa6-427c-a029-a75c49221d25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:46.779688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e7c2c044-eaa6-427c-a029-a75c49221d25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:46.780685 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e7c2c044-eaa6-427c-a029-a75c49221d25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:46.781274 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e7c2c044-eaa6-427c-a029-a75c49221d25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:47.050898 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e7c2c044-eaa6-427c-a029-a75c49221d25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:47.060841 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e7c2c044-eaa6-427c-a029-a75c49221d25 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1513 microversion: 2.1 time: 0.299896 Jun 27 15:31:47.061700 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 343/694] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:46 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1513 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:47.496677 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e9410b43-5ebb-4bf0-aac5-543cb147eb21 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:47.502075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e9410b43-5ebb-4bf0-aac5-543cb147eb21 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:47.521251 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9410b43-5ebb-4bf0-aac5-543cb147eb21 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:47.527999 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9410b43-5ebb-4bf0-aac5-543cb147eb21 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:47.531001 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9410b43-5ebb-4bf0-aac5-543cb147eb21 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:47.535713 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e9410b43-5ebb-4bf0-aac5-543cb147eb21 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:47.707480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-bbb446c4-7629-46b0-910d-55427cf7f2e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:47.708284 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-bbb446c4-7629-46b0-910d-55427cf7f2e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:47.714887 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bbb446c4-7629-46b0-910d-55427cf7f2e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:47.715336 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bbb446c4-7629-46b0-910d-55427cf7f2e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:47.716157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bbb446c4-7629-46b0-910d-55427cf7f2e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:47.716744 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bbb446c4-7629-46b0-910d-55427cf7f2e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:47.827056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-bbb446c4-7629-46b0-910d-55427cf7f2e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lazy-loading 'services' on Instance uuid 6b96384b-617e-4ae6-989b-f16e60189883 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:47.846950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e9410b43-5ebb-4bf0-aac5-543cb147eb21 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:47.857936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e9410b43-5ebb-4bf0-aac5-543cb147eb21 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.370281 Jun 27 15:31:47.868358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 352/695] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:47 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:47.949406 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-bbb446c4-7629-46b0-910d-55427cf7f2e0 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments/66ade38e-6d5a-444c-8c26-288eb44208a3" status: 202 len: 0 microversion: 2.1 time: 0.246881 Jun 27 15:31:47.951135 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 344/696] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:31:47 2022] DELETE /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments/66ade38e-6d5a-444c-8c26-288eb44208a3 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:31:47.960966 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a5b5faa1-c126-49a8-a202-7d135c207128 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:47.962260 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a5b5faa1-c126-49a8-a202-7d135c207128 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:47.988588 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5b5faa1-c126-49a8-a202-7d135c207128 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:47.989420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5b5faa1-c126-49a8-a202-7d135c207128 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:47.990757 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5b5faa1-c126-49a8-a202-7d135c207128 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:47.991811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5b5faa1-c126-49a8-a202-7d135c207128 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:48.047397 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a5b5faa1-c126-49a8-a202-7d135c207128 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091653 Jun 27 15:31:48.048421 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 353/697] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:47 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments => generated 197 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:48.089171 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-03de7778-842c-4fdf-bd12-b571767ac5f7 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:48.090270 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-03de7778-842c-4fdf-bd12-b571767ac5f7 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:48.100584 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03de7778-842c-4fdf-bd12-b571767ac5f7 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:48.101339 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03de7778-842c-4fdf-bd12-b571767ac5f7 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:48.102334 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03de7778-842c-4fdf-bd12-b571767ac5f7 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:48.102934 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-03de7778-842c-4fdf-bd12-b571767ac5f7 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:48.151256 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:48.292700 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-03de7778-842c-4fdf-bd12-b571767ac5f7 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4e1f142fbc2a4159b5ad3a672170db10', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fe9612aa8fdd4be0a4a3ecfaefb96fca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:48.312039 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-03de7778-842c-4fdf-bd12-b571767ac5f7 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 200 len: 1471 microversion: 2.1 time: 0.227193 Jun 27 15:31:48.313211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 345/698] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:48 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 1471 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:31:48.351308 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-af690b3e-9b61-4113-a446-990ec677d87f req-0a7a53a8-3fc2-44bf-8534-50a77c64b97f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edb0650f-918c-45f5-8739-099eb50c3e9a", "name": "network-vif-deleted", "tag": "c4f0c948-b5c3-4c06-8187-bac9f967d7ff"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:48.368606 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-af690b3e-9b61-4113-a446-990ec677d87f req-0a7a53a8-3fc2-44bf-8534-50a77c64b97f service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:48.369680 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-af690b3e-9b61-4113-a446-990ec677d87f req-0a7a53a8-3fc2-44bf-8534-50a77c64b97f service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:48.394945 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-af690b3e-9b61-4113-a446-990ec677d87f req-0a7a53a8-3fc2-44bf-8534-50a77c64b97f service nova] Creating event network-vif-deleted:c4f0c948-b5c3-4c06-8187-bac9f967d7ff for instance edb0650f-918c-45f5-8739-099eb50c3e9a on hv-cinder-84779 Jun 27 15:31:48.404714 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-af690b3e-9b61-4113-a446-990ec677d87f req-0a7a53a8-3fc2-44bf-8534-50a77c64b97f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065431 Jun 27 15:31:48.406234 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 354/699] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:31:48.887124 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5ef1285c-50a9-46d0-827c-1c8883d4951f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:48.889931 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5ef1285c-50a9-46d0-827c-1c8883d4951f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:48.904788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5ef1285c-50a9-46d0-827c-1c8883d4951f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:48.905711 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5ef1285c-50a9-46d0-827c-1c8883d4951f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:48.907583 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5ef1285c-50a9-46d0-827c-1c8883d4951f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:48.912613 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5ef1285c-50a9-46d0-827c-1c8883d4951f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:49.069632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8f689d7c-fb49-4075-8d1d-ea0a74e970c2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:49.073604 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8f689d7c-fb49-4075-8d1d-ea0a74e970c2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:49.104534 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f689d7c-fb49-4075-8d1d-ea0a74e970c2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:49.111917 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f689d7c-fb49-4075-8d1d-ea0a74e970c2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:49.119051 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f689d7c-fb49-4075-8d1d-ea0a74e970c2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:49.121679 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8f689d7c-fb49-4075-8d1d-ea0a74e970c2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:49.204540 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8f689d7c-fb49-4075-8d1d-ea0a74e970c2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.145186 Jun 27 15:31:49.206352 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 355/700] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:31:49 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883/os-volume_attachments => generated 25 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:31:49.343888 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4c430455-a052-4930-b4df-4fdfdfb7bf20 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:49.344406 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4c430455-a052-4930-b4df-4fdfdfb7bf20 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:49.353165 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c430455-a052-4930-b4df-4fdfdfb7bf20 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:49.353743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c430455-a052-4930-b4df-4fdfdfb7bf20 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:49.354550 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c430455-a052-4930-b4df-4fdfdfb7bf20 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:49.355152 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c430455-a052-4930-b4df-4fdfdfb7bf20 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:49.412017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4c430455-a052-4930-b4df-4fdfdfb7bf20 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:31:49.505889 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5ef1285c-50a9-46d0-827c-1c8883d4951f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:49.521967 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5ef1285c-50a9-46d0-827c-1c8883d4951f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.647811 Jun 27 15:31:49.524988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 346/701] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:48 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:49.535400 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-46a7c7f0-10fe-43a8-8a3f-c4cdcb1f3056 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:49.536151 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-46a7c7f0-10fe-43a8-8a3f-c4cdcb1f3056 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] [instance: edb0650f-918c-45f5-8739-099eb50c3e9a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:49.546496 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-46a7c7f0-10fe-43a8-8a3f-c4cdcb1f3056 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:49.546987 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-46a7c7f0-10fe-43a8-8a3f-c4cdcb1f3056 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:49.548439 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-46a7c7f0-10fe-43a8-8a3f-c4cdcb1f3056 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:49.550234 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-46a7c7f0-10fe-43a8-8a3f-c4cdcb1f3056 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:49.600775 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-46a7c7f0-10fe-43a8-8a3f-c4cdcb1f3056 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] HTTP exception thrown: Instance edb0650f-918c-45f5-8739-099eb50c3e9a could not be found. Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-46a7c7f0-10fe-43a8-8a3f-c4cdcb1f3056 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Request method failure captured: Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a HTTP/1.1 Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiuczgyU0UXRSz9iacx9Cq_LiLKiZrCgzzPkjiS92qvy3s_R437MKFZ-J6qfZnaRnDyojwt--F00znvlt06M-mM1G0bAXVyUUhJ5oCNfMKxVCMGZ36rCXs5EWPU13AvDVmPDpdv2JdL8WKB4G_oUSd7NJVKXmoK1pQuLVE2rWg32lRRJo Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: fe9612aa8fdd4be0a4a3ecfaefb96fca Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1686479676 Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:31:49.604998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_fe9612aa8fdd4be0a4a3ecfaefb96fca", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/fe9612aa8fdd4be0a4a3ecfaefb96fca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe9612aa8fdd4be0a4a3ecfaefb96fca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/fe9612aa8fdd4be0a4a3ecfaefb96fca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesSnapshotTestJSON-1686479676 Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: fe9612aa8fdd4be0a4a3ecfaefb96fca Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1686479676 Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesSnapshotTestJSON-1686479676-project Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 4e1f142fbc2a4159b5ad3a672170db10 Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesSnapshotTestJSON-1686479676-project Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance edb0650f-918c-45f5-8739-099eb50c3e9a could not be found. Jun 27 15:31:49.606635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'edb0650f-918c-45f5-8739-099eb50c3e9a'} Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edb0650f-918c-45f5-8739-099eb50c3e9a could not be found. Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:31:49.607502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edb0650f-918c-45f5-8739-099eb50c3e9a could not be found. Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edb0650f-918c-45f5-8739-099eb50c3e9a could not be found. Jun 27 15:31:49.609101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:31:49.611112 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-46a7c7f0-10fe-43a8-8a3f-c4cdcb1f3056 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] Returning 404 to user: Instance edb0650f-918c-45f5-8739-099eb50c3e9a could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:31:49.611112 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-46a7c7f0-10fe-43a8-8a3f-c4cdcb1f3056 tempest-VolumesSnapshotTestJSON-1686479676 tempest-VolumesSnapshotTestJSON-1686479676-project] 10.222.0.26 "GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a" status: 404 len: 111 microversion: 2.1 time: 0.081035 Jun 27 15:31:49.616644 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4c430455-a052-4930-b4df-4fdfdfb7bf20 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 204 len: 0 microversion: 2.1 time: 0.276258 Jun 27 15:31:49.616644 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 356/702] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:31:49 2022] DELETE /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:31:49.632709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 347/703] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:49 2022] GET /compute/v2.1/servers/edb0650f-918c-45f5-8739-099eb50c3e9a => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:31:49.650384 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e44d73c5-d6af-4958-90f8-0d463249bb4a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:49.651779 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e44d73c5-d6af-4958-90f8-0d463249bb4a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:49.659499 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-6399c9b8-b481-466e-ac95-87c608cb1532 req-92cf44ff-af77-4d94-b967-322d339cd1d1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902ddcef-106e-4a57-a046-8ea9f13aa8a1", "tag": "08e3ae6c-5577-48e3-8481-9b2849653b64"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:49.680948 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e44d73c5-d6af-4958-90f8-0d463249bb4a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:49.682269 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e44d73c5-d6af-4958-90f8-0d463249bb4a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:49.685296 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e44d73c5-d6af-4958-90f8-0d463249bb4a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:49.686157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-6399c9b8-b481-466e-ac95-87c608cb1532 req-92cf44ff-af77-4d94-b967-322d339cd1d1 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:49.686621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-6399c9b8-b481-466e-ac95-87c608cb1532 req-92cf44ff-af77-4d94-b967-322d339cd1d1 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:49.687279 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e44d73c5-d6af-4958-90f8-0d463249bb4a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:49.704942 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-6399c9b8-b481-466e-ac95-87c608cb1532 req-92cf44ff-af77-4d94-b967-322d339cd1d1 service nova] Creating event network-changed:08e3ae6c-5577-48e3-8481-9b2849653b64 for instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 on hv-cinder-84779 Jun 27 15:31:49.710749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-6399c9b8-b481-466e-ac95-87c608cb1532 req-92cf44ff-af77-4d94-b967-322d339cd1d1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070077 Jun 27 15:31:49.716915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 348/704] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:49.738789 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-745495036", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f2b3a5f-8943-48e2-bb0f-3f837d61206a"}], "security_groups": [{"name": "tempest-securitygroup--949208031"}], "key_name": "tempest-keypair-1827982800", "user_data": "}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:49.911178 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] validate_networks() for [('9f2b3a5f-8943-48e2-bb0f-3f837d61206a', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:31:49.975956 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e44d73c5-d6af-4958-90f8-0d463249bb4a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:49.984954 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e44d73c5-d6af-4958-90f8-0d463249bb4a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1688 microversion: 2.1 time: 0.356318 Jun 27 15:31:50.005030 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 357/705] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:49 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1688 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:50.507990 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:31:50.508468 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:31:50.508956 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:31:50.509363 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:31:50.509773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:31:50.519768 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:50.520294 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:50.521059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:50.521498 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:50.540305 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for project dff1983b1b3047378b88d87d54aa709d. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:31:50.544918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for user 23abc809ab644c1da0270a35ac8bab21 and project dff1983b1b3047378b88d87d54aa709d. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:31:50.558334 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:31:50.558616 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-63682606-952a-4379-b6f7-ab57ba9a71cb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:50.559736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-63682606-952a-4379-b6f7-ab57ba9a71cb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:50.560825 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:31:50.571598 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63682606-952a-4379-b6f7-ab57ba9a71cb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:50.572461 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63682606-952a-4379-b6f7-ab57ba9a71cb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:50.573785 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63682606-952a-4379-b6f7-ab57ba9a71cb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:50.574539 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63682606-952a-4379-b6f7-ab57ba9a71cb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:50.623693 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e483f2af-3a11-43c7-b49a-47e48c2a9eff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.892367 Jun 27 15:31:50.624381 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 349/706] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:31:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 894 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:31:50.637510 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-76dfac86-a1e4-4460-b4d9-150a9bf82f25 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:50.638570 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-76dfac86-a1e4-4460-b4d9-150a9bf82f25 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:50.654678 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:50.739846 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-76dfac86-a1e4-4460-b4d9-150a9bf82f25 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:50.760392 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-76dfac86-a1e4-4460-b4d9-150a9bf82f25 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1241 microversion: 2.1 time: 0.128884 Jun 27 15:31:50.761539 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 350/707] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:50 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1241 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:50.793748 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-63682606-952a-4379-b6f7-ab57ba9a71cb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:50.807580 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-63682606-952a-4379-b6f7-ab57ba9a71cb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.256760 Jun 27 15:31:50.809043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 358/708] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:50 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:51.013300 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d30ad867-742b-4fa3-837e-3f0c1ce0313c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:51.014798 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d30ad867-742b-4fa3-837e-3f0c1ce0313c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:51.024044 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d30ad867-742b-4fa3-837e-3f0c1ce0313c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:51.024554 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d30ad867-742b-4fa3-837e-3f0c1ce0313c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:51.025681 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d30ad867-742b-4fa3-837e-3f0c1ce0313c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:51.026115 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d30ad867-742b-4fa3-837e-3f0c1ce0313c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:51.263544 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d30ad867-742b-4fa3-837e-3f0c1ce0313c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:51.278941 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d30ad867-742b-4fa3-837e-3f0c1ce0313c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1688 microversion: 2.1 time: 0.270734 Jun 27 15:31:51.280543 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 351/709] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:51 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1688 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:31:51.778420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c2a8735f-35c0-49f3-985c-1374af6d7da9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:51.779147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c2a8735f-35c0-49f3-985c-1374af6d7da9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:51.788469 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c2a8735f-35c0-49f3-985c-1374af6d7da9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:51.789207 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c2a8735f-35c0-49f3-985c-1374af6d7da9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:51.790633 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c2a8735f-35c0-49f3-985c-1374af6d7da9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:51.791390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c2a8735f-35c0-49f3-985c-1374af6d7da9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:51.840065 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-04eaa905-88a6-4fe3-9168-ac77b3275ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:51.841138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-04eaa905-88a6-4fe3-9168-ac77b3275ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:51.853303 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-04eaa905-88a6-4fe3-9168-ac77b3275ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:51.854116 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-04eaa905-88a6-4fe3-9168-ac77b3275ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:51.855368 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-04eaa905-88a6-4fe3-9168-ac77b3275ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:51.856716 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-04eaa905-88a6-4fe3-9168-ac77b3275ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:52.033518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-04eaa905-88a6-4fe3-9168-ac77b3275ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:52.042016 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-04eaa905-88a6-4fe3-9168-ac77b3275ed6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.212291 Jun 27 15:31:52.042693 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 352/710] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:51 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:52.104182 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c2a8735f-35c0-49f3-985c-1374af6d7da9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:52.112877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c2a8735f-35c0-49f3-985c-1374af6d7da9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1245 microversion: 2.1 time: 0.338084 Jun 27 15:31:52.113381 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 359/711] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:51 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1245 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:52.311753 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f8eeb3b6-a20c-434b-aab4-2213743916ce tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:52.312418 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f8eeb3b6-a20c-434b-aab4-2213743916ce tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:52.320100 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f8eeb3b6-a20c-434b-aab4-2213743916ce tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:52.320574 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f8eeb3b6-a20c-434b-aab4-2213743916ce tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:52.321458 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f8eeb3b6-a20c-434b-aab4-2213743916ce tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:52.321896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f8eeb3b6-a20c-434b-aab4-2213743916ce tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:52.496203 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f8eeb3b6-a20c-434b-aab4-2213743916ce tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:52.509537 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f8eeb3b6-a20c-434b-aab4-2213743916ce tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1688 microversion: 2.1 time: 0.202320 Jun 27 15:31:52.510517 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 353/712] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:52 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1688 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:53.067166 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-db6f2e88-7552-41e1-8b85-0daddc093466 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:53.067785 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-db6f2e88-7552-41e1-8b85-0daddc093466 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:53.069977 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:53.077252 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db6f2e88-7552-41e1-8b85-0daddc093466 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:53.077689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db6f2e88-7552-41e1-8b85-0daddc093466 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:53.078498 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db6f2e88-7552-41e1-8b85-0daddc093466 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:53.078924 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-db6f2e88-7552-41e1-8b85-0daddc093466 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:53.097392 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:53.142373 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6091ff03-f3ce-49ba-b951-2f51cf8d971a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:53.143429 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-6091ff03-f3ce-49ba-b951-2f51cf8d971a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:53.154152 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6091ff03-f3ce-49ba-b951-2f51cf8d971a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:53.155176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6091ff03-f3ce-49ba-b951-2f51cf8d971a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:53.156633 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6091ff03-f3ce-49ba-b951-2f51cf8d971a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:53.157326 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6091ff03-f3ce-49ba-b951-2f51cf8d971a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:53.244190 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-db6f2e88-7552-41e1-8b85-0daddc093466 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:53.247658 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6091ff03-f3ce-49ba-b951-2f51cf8d971a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:53.255491 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-db6f2e88-7552-41e1-8b85-0daddc093466 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.192655 Jun 27 15:31:53.255998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-6091ff03-f3ce-49ba-b951-2f51cf8d971a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1245 microversion: 2.1 time: 0.120529 Jun 27 15:31:53.256728 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 360/713] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:53 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:53.256949 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 354/714] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:53 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1245 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:53.530002 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f0549010-8fd6-4b83-a8c7-a9c503ee128d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:53.530617 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f0549010-8fd6-4b83-a8c7-a9c503ee128d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:53.537912 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0549010-8fd6-4b83-a8c7-a9c503ee128d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:53.538414 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0549010-8fd6-4b83-a8c7-a9c503ee128d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:53.539153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0549010-8fd6-4b83-a8c7-a9c503ee128d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:53.539566 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f0549010-8fd6-4b83-a8c7-a9c503ee128d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:53.696165 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f0549010-8fd6-4b83-a8c7-a9c503ee128d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:53.704964 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f0549010-8fd6-4b83-a8c7-a9c503ee128d tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1688 microversion: 2.1 time: 0.178957 Jun 27 15:31:53.706011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 361/715] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:53 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1688 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:54.276653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c1eb116e-6c24-485d-a2a2-59fede61850c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:54.277609 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c1eb116e-6c24-485d-a2a2-59fede61850c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:54.284926 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-826d6296-4d5f-4411-9214-09dee0ca74a8 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:54.285976 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-826d6296-4d5f-4411-9214-09dee0ca74a8 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:54.295069 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c1eb116e-6c24-485d-a2a2-59fede61850c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:54.298009 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c1eb116e-6c24-485d-a2a2-59fede61850c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:54.299847 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c1eb116e-6c24-485d-a2a2-59fede61850c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:54.300292 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c1eb116e-6c24-485d-a2a2-59fede61850c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:54.303046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-826d6296-4d5f-4411-9214-09dee0ca74a8 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:54.303495 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-826d6296-4d5f-4411-9214-09dee0ca74a8 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:54.304344 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-826d6296-4d5f-4411-9214-09dee0ca74a8 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:54.304741 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-826d6296-4d5f-4411-9214-09dee0ca74a8 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:54.463000 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-826d6296-4d5f-4411-9214-09dee0ca74a8 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:54.481293 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-826d6296-4d5f-4411-9214-09dee0ca74a8 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1245 microversion: 2.1 time: 0.211303 Jun 27 15:31:54.493016 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 355/716] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:54 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1245 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:54.573562 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c1eb116e-6c24-485d-a2a2-59fede61850c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:54.588240 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c1eb116e-6c24-485d-a2a2-59fede61850c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.316574 Jun 27 15:31:54.605328 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 362/717] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:54 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:54.733747 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5fbc957d-cee1-4c84-8718-27fba51f0348 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:54.735153 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5fbc957d-cee1-4c84-8718-27fba51f0348 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:54.747185 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5fbc957d-cee1-4c84-8718-27fba51f0348 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:54.747894 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5fbc957d-cee1-4c84-8718-27fba51f0348 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:54.749559 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5fbc957d-cee1-4c84-8718-27fba51f0348 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:54.750225 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5fbc957d-cee1-4c84-8718-27fba51f0348 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:55.257267 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5fbc957d-cee1-4c84-8718-27fba51f0348 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:55.270869 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5fbc957d-cee1-4c84-8718-27fba51f0348 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1688 microversion: 2.1 time: 0.542469 Jun 27 15:31:55.284492 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 356/718] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:54 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1688 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:31:55.514689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-29506356-2bcc-4906-8157-9d7ccc3e588b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:55.516169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-29506356-2bcc-4906-8157-9d7ccc3e588b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:55.530213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29506356-2bcc-4906-8157-9d7ccc3e588b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:55.531130 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29506356-2bcc-4906-8157-9d7ccc3e588b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:55.533092 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29506356-2bcc-4906-8157-9d7ccc3e588b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:55.535017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-29506356-2bcc-4906-8157-9d7ccc3e588b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:55.618102 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9ff16303-e081-4248-95e0-c42dc64cb206 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:55.620208 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9ff16303-e081-4248-95e0-c42dc64cb206 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:55.634768 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9ff16303-e081-4248-95e0-c42dc64cb206 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:55.635728 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9ff16303-e081-4248-95e0-c42dc64cb206 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:55.637335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9ff16303-e081-4248-95e0-c42dc64cb206 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:55.638435 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9ff16303-e081-4248-95e0-c42dc64cb206 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:55.658115 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-29506356-2bcc-4906-8157-9d7ccc3e588b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:55.694725 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-29506356-2bcc-4906-8157-9d7ccc3e588b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1299 microversion: 2.1 time: 0.187253 Jun 27 15:31:55.695766 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 363/719] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:55 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1299 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:56.289590 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-255c3fe5-7d66-4e03-b802-d3a8ca51bf36 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:56.290223 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-255c3fe5-7d66-4e03-b802-d3a8ca51bf36 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:56.292352 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=16 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:31:56.309241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-255c3fe5-7d66-4e03-b802-d3a8ca51bf36 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:56.338931 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-255c3fe5-7d66-4e03-b802-d3a8ca51bf36 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:56.342365 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-255c3fe5-7d66-4e03-b802-d3a8ca51bf36 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:56.343501 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-255c3fe5-7d66-4e03-b802-d3a8ca51bf36 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:56.362744 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9ff16303-e081-4248-95e0-c42dc64cb206 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:56.378805 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9ff16303-e081-4248-95e0-c42dc64cb206 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.767671 Jun 27 15:31:56.379611 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 357/720] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:55 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:31:56.547478 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-255c3fe5-7d66-4e03-b802-d3a8ca51bf36 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:56.563266 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-255c3fe5-7d66-4e03-b802-d3a8ca51bf36 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1688 microversion: 2.1 time: 0.277201 Jun 27 15:31:56.565211 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 364/721] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:56 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1688 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:56.717714 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-76f8d912-fd57-42bc-9818-5449d4decfaf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:56.725585 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-76f8d912-fd57-42bc-9818-5449d4decfaf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:56.737388 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76f8d912-fd57-42bc-9818-5449d4decfaf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:56.738507 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76f8d912-fd57-42bc-9818-5449d4decfaf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:56.740837 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76f8d912-fd57-42bc-9818-5449d4decfaf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:56.741677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76f8d912-fd57-42bc-9818-5449d4decfaf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:57.056663 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-0ce7b08e-c442-4174-b3cf-7111e4808b13 req-ceb3841f-28f3-4aef-8cc6-381921306b8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b96384b-617e-4ae6-989b-f16e60189883", "name": "network-vif-deleted", "tag": "44036d57-a43c-4cb8-b4e7-dad2d8ab154a"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:57.065701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-76f8d912-fd57-42bc-9818-5449d4decfaf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:57.091340 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-76f8d912-fd57-42bc-9818-5449d4decfaf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.381673 Jun 27 15:31:57.096228 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-0ce7b08e-c442-4174-b3cf-7111e4808b13 req-ceb3841f-28f3-4aef-8cc6-381921306b8a service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:57.097075 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 358/722] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:56 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:31:57.098227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-0ce7b08e-c442-4174-b3cf-7111e4808b13 req-ceb3841f-28f3-4aef-8cc6-381921306b8a service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:57.122259 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-0ce7b08e-c442-4174-b3cf-7111e4808b13 req-ceb3841f-28f3-4aef-8cc6-381921306b8a service nova] Creating event network-vif-deleted:44036d57-a43c-4cb8-b4e7-dad2d8ab154a for instance 6b96384b-617e-4ae6-989b-f16e60189883 on hv-cinder-84779 Jun 27 15:31:57.128743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-0ce7b08e-c442-4174-b3cf-7111e4808b13 req-ceb3841f-28f3-4aef-8cc6-381921306b8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080177 Jun 27 15:31:57.130007 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 365/723] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:31:57.403924 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b22b4318-36c9-487c-8796-cd5852f46613 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:57.404976 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b22b4318-36c9-487c-8796-cd5852f46613 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:57.423171 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b22b4318-36c9-487c-8796-cd5852f46613 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:57.424422 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b22b4318-36c9-487c-8796-cd5852f46613 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:57.425933 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b22b4318-36c9-487c-8796-cd5852f46613 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:57.426998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b22b4318-36c9-487c-8796-cd5852f46613 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:57.597090 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:57.598420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:57.616741 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:57.618400 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:57.620958 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:57.622442 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:57.661131 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b22b4318-36c9-487c-8796-cd5852f46613 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:57.672606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b22b4318-36c9-487c-8796-cd5852f46613 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.273696 Jun 27 15:31:57.673985 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 359/724] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:57 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:57.687004 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:57.687742 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:57.688455 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lazy-loading 'fault' on Instance uuid 6b96384b-617e-4ae6-989b-f16e60189883 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:31:57.771444 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:57.795687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b131080d-69f2-4e24-9920-2962f4eb4048 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 200 len: 1335 microversion: 2.1 time: 0.215675 Jun 27 15:31:57.800815 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 366/725] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:57 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 1335 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:58.117033 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a8dffcb9-ec8b-4242-8403-83c0948baa8f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:58.119376 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a8dffcb9-ec8b-4242-8403-83c0948baa8f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:58.128310 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8dffcb9-ec8b-4242-8403-83c0948baa8f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:58.128882 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8dffcb9-ec8b-4242-8403-83c0948baa8f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:58.129618 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8dffcb9-ec8b-4242-8403-83c0948baa8f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:58.130065 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8dffcb9-ec8b-4242-8403-83c0948baa8f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:58.362135 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a8dffcb9-ec8b-4242-8403-83c0948baa8f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:58.373895 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a8dffcb9-ec8b-4242-8403-83c0948baa8f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.267197 Jun 27 15:31:58.382834 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 360/726] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:58 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:58.539850 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-c7443e21-abd4-4496-9411-ddf5093d1ee7 req-a4765c65-8aa0-4bf5-9029-41ad104ef950 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3afef28-40eb-48c6-a65c-f549cc963cda", "tag": "15808846-1217-422f-a8ef-2e30bfe2ee06"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:31:58.549316 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-c7443e21-abd4-4496-9411-ddf5093d1ee7 req-a4765c65-8aa0-4bf5-9029-41ad104ef950 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:58.550077 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-c7443e21-abd4-4496-9411-ddf5093d1ee7 req-a4765c65-8aa0-4bf5-9029-41ad104ef950 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:58.591780 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-c7443e21-abd4-4496-9411-ddf5093d1ee7 req-a4765c65-8aa0-4bf5-9029-41ad104ef950 service nova] Creating event network-changed:15808846-1217-422f-a8ef-2e30bfe2ee06 for instance a3afef28-40eb-48c6-a65c-f549cc963cda on hv-cinder-84779 Jun 27 15:31:58.607614 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-c7443e21-abd4-4496-9411-ddf5093d1ee7 req-a4765c65-8aa0-4bf5-9029-41ad104ef950 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071333 Jun 27 15:31:58.609231 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 367/727] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:31:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:31:58.706051 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-aba0807a-392b-4f20-915d-9b99680af007 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:58.708685 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-aba0807a-392b-4f20-915d-9b99680af007 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:58.722026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aba0807a-392b-4f20-915d-9b99680af007 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:58.724701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aba0807a-392b-4f20-915d-9b99680af007 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:58.727177 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aba0807a-392b-4f20-915d-9b99680af007 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:58.728503 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aba0807a-392b-4f20-915d-9b99680af007 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:58.837458 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-73d4f7d0-fc05-43aa-bf7d-403763548248 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:58.839768 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-73d4f7d0-fc05-43aa-bf7d-403763548248 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 6b96384b-617e-4ae6-989b-f16e60189883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:58.854880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73d4f7d0-fc05-43aa-bf7d-403763548248 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:58.856828 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73d4f7d0-fc05-43aa-bf7d-403763548248 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:58.859109 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73d4f7d0-fc05-43aa-bf7d-403763548248 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:58.860952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-73d4f7d0-fc05-43aa-bf7d-403763548248 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:58.886253 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-73d4f7d0-fc05-43aa-bf7d-403763548248 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] HTTP exception thrown: Instance 6b96384b-617e-4ae6-989b-f16e60189883 could not be found. Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-73d4f7d0-fc05-43aa-bf7d-403763548248 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Request method failure captured: Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 HTTP/1.1 Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwoSnYhPWU8-WWSH7wGBafQXIjG8xq98RxBC5ln0qY8NkV2iLRGT08tr0ASJ32aKDac2AetAJt5KEH-MB45B6tNlCKvzjpp2VxDDEmGGD9f2DWMJUawGMuLpCecS5Sr5leKkWGj1HDRn5lcOcvOa-_F1S9KTpDSmAaKp-xUVFJjM6g Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 2832173587a6494eb7f73b3ca0a09a0f Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:31:58.888651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2832173587a6494eb7f73b3ca0a09a0f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 2832173587a6494eb7f73b3ca0a09a0f Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-ServerRescueNegativeTestJSON-640731549-project Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: effe0200dc584f11923e83ed240138ff Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-ServerRescueNegativeTestJSON-640731549-project Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 6b96384b-617e-4ae6-989b-f16e60189883 could not be found. Jun 27 15:31:58.890653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '6b96384b-617e-4ae6-989b-f16e60189883'} Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b96384b-617e-4ae6-989b-f16e60189883 could not be found. Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:31:58.891476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b96384b-617e-4ae6-989b-f16e60189883 could not be found. Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b96384b-617e-4ae6-989b-f16e60189883 could not be found. Jun 27 15:31:58.893872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:31:58.896151 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-73d4f7d0-fc05-43aa-bf7d-403763548248 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Returning 404 to user: Instance 6b96384b-617e-4ae6-989b-f16e60189883 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:31:58.897219 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-73d4f7d0-fc05-43aa-bf7d-403763548248 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883" status: 404 len: 111 microversion: 2.1 time: 0.070488 Jun 27 15:31:58.898298 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 368/728] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:58 2022] GET /compute/v2.1/servers/6b96384b-617e-4ae6-989b-f16e60189883 => generated 111 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:31:58.909001 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-035a1523-e340-44cd-8471-8c1404481d87 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '.version_select at 0x7fb2734f1040>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:58.934762 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-035a1523-e340-44cd-8471-8c1404481d87 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032320801" status: 202 len: 0 microversion: 2.1 time: 0.029987 Jun 27 15:31:58.935847 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 369/729] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jun 27 15:31:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1032320801 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:31:59.004575 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-aba0807a-392b-4f20-915d-9b99680af007 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:59.014049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-aba0807a-392b-4f20-915d-9b99680af007 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.319444 Jun 27 15:31:59.014646 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 361/730] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:58 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:31:59.394247 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ed27f6a2-7880-4185-97b2-33f6b4eebc16 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:31:59.394439 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ed27f6a2-7880-4185-97b2-33f6b4eebc16 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:31:59.409729 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed27f6a2-7880-4185-97b2-33f6b4eebc16 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:59.411075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed27f6a2-7880-4185-97b2-33f6b4eebc16 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:59.412736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed27f6a2-7880-4185-97b2-33f6b4eebc16 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:31:59.413405 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed27f6a2-7880-4185-97b2-33f6b4eebc16 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:31:59.605786 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ed27f6a2-7880-4185-97b2-33f6b4eebc16 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:31:59.614531 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ed27f6a2-7880-4185-97b2-33f6b4eebc16 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.226342 Jun 27 15:31:59.615318 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 370/731] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:31:59 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:00.043014 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-762a1783-5305-4aed-8b28-2876f01e3a26 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:00.043788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-762a1783-5305-4aed-8b28-2876f01e3a26 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:00.056913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-762a1783-5305-4aed-8b28-2876f01e3a26 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:00.058213 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-762a1783-5305-4aed-8b28-2876f01e3a26 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:00.059370 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-762a1783-5305-4aed-8b28-2876f01e3a26 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:00.060088 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-762a1783-5305-4aed-8b28-2876f01e3a26 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:00.217733 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-762a1783-5305-4aed-8b28-2876f01e3a26 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:00.233401 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-762a1783-5305-4aed-8b28-2876f01e3a26 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.198005 Jun 27 15:32:00.233991 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 362/732] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:00 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:00.631725 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c837c5c3-ca99-408c-8252-5eaff1685d38 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:00.632415 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c837c5c3-ca99-408c-8252-5eaff1685d38 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:00.639559 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c837c5c3-ca99-408c-8252-5eaff1685d38 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:00.640020 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c837c5c3-ca99-408c-8252-5eaff1685d38 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:00.640843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c837c5c3-ca99-408c-8252-5eaff1685d38 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:00.641281 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c837c5c3-ca99-408c-8252-5eaff1685d38 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:00.839272 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c837c5c3-ca99-408c-8252-5eaff1685d38 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:00.854461 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c837c5c3-ca99-408c-8252-5eaff1685d38 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.226548 Jun 27 15:32:00.855487 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 371/733] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:00 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:01.250058 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-110b8123-4046-4e82-ab17-74ef15c980ac tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:01.250671 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-110b8123-4046-4e82-ab17-74ef15c980ac tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:01.252780 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:01.253627 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=8 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:01.260350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-110b8123-4046-4e82-ab17-74ef15c980ac tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:01.260785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-110b8123-4046-4e82-ab17-74ef15c980ac tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:01.261556 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-110b8123-4046-4e82-ab17-74ef15c980ac tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:01.261986 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-110b8123-4046-4e82-ab17-74ef15c980ac tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:01.402911 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-110b8123-4046-4e82-ab17-74ef15c980ac tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:01.411120 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-110b8123-4046-4e82-ab17-74ef15c980ac tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.164991 Jun 27 15:32:01.411704 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 363/734] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:01 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:01.873448 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5e7c5800-c2bc-4de1-b81d-8b865c6e1ee5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:01.874079 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5e7c5800-c2bc-4de1-b81d-8b865c6e1ee5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:01.882472 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e7c5800-c2bc-4de1-b81d-8b865c6e1ee5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:01.882958 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e7c5800-c2bc-4de1-b81d-8b865c6e1ee5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:01.883966 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e7c5800-c2bc-4de1-b81d-8b865c6e1ee5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:01.884287 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5e7c5800-c2bc-4de1-b81d-8b865c6e1ee5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:02.028144 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5e7c5800-c2bc-4de1-b81d-8b865c6e1ee5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:02.036859 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5e7c5800-c2bc-4de1-b81d-8b865c6e1ee5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.167501 Jun 27 15:32:02.037464 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 372/735] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:01 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:02.429626 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fcc4e989-862b-4b87-95ed-20e49bbc0289 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:02.430226 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-fcc4e989-862b-4b87-95ed-20e49bbc0289 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:02.438479 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fcc4e989-862b-4b87-95ed-20e49bbc0289 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:02.438997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fcc4e989-862b-4b87-95ed-20e49bbc0289 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:02.439874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fcc4e989-862b-4b87-95ed-20e49bbc0289 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:02.440571 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fcc4e989-862b-4b87-95ed-20e49bbc0289 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:02.594226 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fcc4e989-862b-4b87-95ed-20e49bbc0289 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:02.608989 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fcc4e989-862b-4b87-95ed-20e49bbc0289 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.183382 Jun 27 15:32:02.610050 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 364/736] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:02 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:03.065511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a01ef51e-213f-481e-8e6f-e00b6362c0dd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:03.066656 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a01ef51e-213f-481e-8e6f-e00b6362c0dd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:03.078582 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a01ef51e-213f-481e-8e6f-e00b6362c0dd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:03.079374 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a01ef51e-213f-481e-8e6f-e00b6362c0dd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:03.080946 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a01ef51e-213f-481e-8e6f-e00b6362c0dd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:03.081694 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a01ef51e-213f-481e-8e6f-e00b6362c0dd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:03.318012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a01ef51e-213f-481e-8e6f-e00b6362c0dd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:03.327060 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a01ef51e-213f-481e-8e6f-e00b6362c0dd tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.268444 Jun 27 15:32:03.327686 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 373/737] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:03 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:03.629316 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3b35b686-8c7d-4f3b-a1c6-b5f62fbbedfb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:03.630739 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3b35b686-8c7d-4f3b-a1c6-b5f62fbbedfb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:03.644531 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b35b686-8c7d-4f3b-a1c6-b5f62fbbedfb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:03.645521 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b35b686-8c7d-4f3b-a1c6-b5f62fbbedfb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:03.645521 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b35b686-8c7d-4f3b-a1c6-b5f62fbbedfb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:03.646372 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3b35b686-8c7d-4f3b-a1c6-b5f62fbbedfb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:03.650816 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=100 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:03.802163 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3b35b686-8c7d-4f3b-a1c6-b5f62fbbedfb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:03.810382 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3b35b686-8c7d-4f3b-a1c6-b5f62fbbedfb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.185966 Jun 27 15:32:03.811586 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 365/738] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:03 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:04.345086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ed13ff4f-105f-4d39-a729-a5a71dc99419 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:04.345901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ed13ff4f-105f-4d39-a729-a5a71dc99419 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:04.354282 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed13ff4f-105f-4d39-a729-a5a71dc99419 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:04.354706 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed13ff4f-105f-4d39-a729-a5a71dc99419 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:04.355514 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed13ff4f-105f-4d39-a729-a5a71dc99419 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:04.355979 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ed13ff4f-105f-4d39-a729-a5a71dc99419 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:04.458185 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-34dab265-0dea-4019-97a1-4f53a45eb5bb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:04.458695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-34dab265-0dea-4019-97a1-4f53a45eb5bb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:04.465823 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34dab265-0dea-4019-97a1-4f53a45eb5bb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:04.466690 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34dab265-0dea-4019-97a1-4f53a45eb5bb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:04.467492 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34dab265-0dea-4019-97a1-4f53a45eb5bb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:04.467927 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-34dab265-0dea-4019-97a1-4f53a45eb5bb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:04.506122 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-34dab265-0dea-4019-97a1-4f53a45eb5bb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Going to try to terminate instance {{(pid=117977) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:32:04.536016 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ed13ff4f-105f-4d39-a729-a5a71dc99419 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:04.544071 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ed13ff4f-105f-4d39-a729-a5a71dc99419 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.203006 Jun 27 15:32:04.545209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 374/739] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:04 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:04.604445 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-34dab265-0dea-4019-97a1-4f53a45eb5bb tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 204 len: 0 microversion: 2.1 time: 0.150681 Jun 27 15:32:04.605219 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 366/740] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:32:04 2022] DELETE /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 15:32:04.615681 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-11bfe542-58dc-4a24-beef-8f26a2fa571c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:04.616291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-11bfe542-58dc-4a24-beef-8f26a2fa571c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:04.623080 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11bfe542-58dc-4a24-beef-8f26a2fa571c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:04.623525 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11bfe542-58dc-4a24-beef-8f26a2fa571c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:04.624636 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11bfe542-58dc-4a24-beef-8f26a2fa571c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:04.625079 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-11bfe542-58dc-4a24-beef-8f26a2fa571c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:04.640159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-a4791bec-3afd-4d83-a895-c8055e60692f req-b1bb99fe-5517-4957-aa1c-13deba33aead service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902ddcef-106e-4a57-a046-8ea9f13aa8a1", "name": "network-vif-plugged", "status": "completed", "tag": "08e3ae6c-5577-48e3-8481-9b2849653b64"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:04.654232 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-a4791bec-3afd-4d83-a895-c8055e60692f req-b1bb99fe-5517-4957-aa1c-13deba33aead service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:04.655067 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-a4791bec-3afd-4d83-a895-c8055e60692f req-b1bb99fe-5517-4957-aa1c-13deba33aead service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:04.674183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-a4791bec-3afd-4d83-a895-c8055e60692f req-b1bb99fe-5517-4957-aa1c-13deba33aead service nova] Creating event network-vif-plugged:08e3ae6c-5577-48e3-8481-9b2849653b64 for instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 on hv-cinder-84779 Jun 27 15:32:04.680169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-a4791bec-3afd-4d83-a895-c8055e60692f req-b1bb99fe-5517-4957-aa1c-13deba33aead service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046143 Jun 27 15:32:04.680830 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 367/741] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:32:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:32:04.783349 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-11bfe542-58dc-4a24-beef-8f26a2fa571c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:04.794038 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-11bfe542-58dc-4a24-beef-8f26a2fa571c tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1507 microversion: 2.1 time: 0.183293 Jun 27 15:32:04.794635 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 375/742] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:04 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1507 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:04.830108 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9781bf13-b672-4660-8f01-1711727689b2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:04.830887 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9781bf13-b672-4660-8f01-1711727689b2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:04.837624 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9781bf13-b672-4660-8f01-1711727689b2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:04.838063 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9781bf13-b672-4660-8f01-1711727689b2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:04.838836 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9781bf13-b672-4660-8f01-1711727689b2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:04.839275 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9781bf13-b672-4660-8f01-1711727689b2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:04.985598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9781bf13-b672-4660-8f01-1711727689b2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:04.999273 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9781bf13-b672-4660-8f01-1711727689b2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.173022 Jun 27 15:32:05.000416 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 368/743] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:04 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:05.571772 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c90d98d7-1a79-4026-9530-81349913ddff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:05.572539 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c90d98d7-1a79-4026-9530-81349913ddff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:05.579706 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c90d98d7-1a79-4026-9530-81349913ddff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:05.580283 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c90d98d7-1a79-4026-9530-81349913ddff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:05.581846 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c90d98d7-1a79-4026-9530-81349913ddff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:05.582273 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c90d98d7-1a79-4026-9530-81349913ddff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:05.732750 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c90d98d7-1a79-4026-9530-81349913ddff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:05.741529 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c90d98d7-1a79-4026-9530-81349913ddff tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.173968 Jun 27 15:32:05.742096 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 376/744] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:05 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:05.813782 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a864cbcf-c6e7-4e61-9bd1-f827ddee12c6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:05.814764 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a864cbcf-c6e7-4e61-9bd1-f827ddee12c6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:05.821847 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a864cbcf-c6e7-4e61-9bd1-f827ddee12c6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:05.822289 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a864cbcf-c6e7-4e61-9bd1-f827ddee12c6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:05.823081 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a864cbcf-c6e7-4e61-9bd1-f827ddee12c6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:05.823505 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a864cbcf-c6e7-4e61-9bd1-f827ddee12c6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:05.970200 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a864cbcf-c6e7-4e61-9bd1-f827ddee12c6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:05.980241 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a864cbcf-c6e7-4e61-9bd1-f827ddee12c6 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1507 microversion: 2.1 time: 0.170324 Jun 27 15:32:05.980866 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 369/745] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:05 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1507 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:06.024974 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5d1c69a7-2a91-42db-be06-1630d484a74e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:06.025599 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5d1c69a7-2a91-42db-be06-1630d484a74e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:06.032756 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d1c69a7-2a91-42db-be06-1630d484a74e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:06.033584 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d1c69a7-2a91-42db-be06-1630d484a74e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:06.034404 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d1c69a7-2a91-42db-be06-1630d484a74e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:06.034830 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d1c69a7-2a91-42db-be06-1630d484a74e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:06.185052 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5d1c69a7-2a91-42db-be06-1630d484a74e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:06.193691 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5d1c69a7-2a91-42db-be06-1630d484a74e tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.172725 Jun 27 15:32:06.194293 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 377/746] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:06 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:06.759963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6b848010-9d54-45ef-b590-6c537e5a31d6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:06.760616 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-6b848010-9d54-45ef-b590-6c537e5a31d6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:06.767787 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6b848010-9d54-45ef-b590-6c537e5a31d6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:06.768581 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6b848010-9d54-45ef-b590-6c537e5a31d6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:06.769569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6b848010-9d54-45ef-b590-6c537e5a31d6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:06.770062 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6b848010-9d54-45ef-b590-6c537e5a31d6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:06.939353 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6b848010-9d54-45ef-b590-6c537e5a31d6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:06.948658 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-6b848010-9d54-45ef-b590-6c537e5a31d6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.192718 Jun 27 15:32:06.949255 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 370/747] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:06 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:06.999416 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-32195853-0c1b-47f3-9dcb-e5d6a64fa3ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:07.000763 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-32195853-0c1b-47f3-9dcb-e5d6a64fa3ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:07.009411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32195853-0c1b-47f3-9dcb-e5d6a64fa3ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:07.009852 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32195853-0c1b-47f3-9dcb-e5d6a64fa3ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:07.010693 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32195853-0c1b-47f3-9dcb-e5d6a64fa3ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:07.011353 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-32195853-0c1b-47f3-9dcb-e5d6a64fa3ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:07.195876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-32195853-0c1b-47f3-9dcb-e5d6a64fa3ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:07.206740 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-32195853-0c1b-47f3-9dcb-e5d6a64fa3ea tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1507 microversion: 2.1 time: 0.209239 Jun 27 15:32:07.212351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-85dc7c73-d316-4540-9420-7cc8f7bf2139 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:07.212842 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-85dc7c73-d316-4540-9420-7cc8f7bf2139 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:07.214689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 378/748] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:06 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1507 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:32:07.219842 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-85dc7c73-d316-4540-9420-7cc8f7bf2139 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:07.220419 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-85dc7c73-d316-4540-9420-7cc8f7bf2139 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:07.221612 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-85dc7c73-d316-4540-9420-7cc8f7bf2139 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:07.222295 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-85dc7c73-d316-4540-9420-7cc8f7bf2139 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:07.412172 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-85dc7c73-d316-4540-9420-7cc8f7bf2139 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:07.424552 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-85dc7c73-d316-4540-9420-7cc8f7bf2139 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.216118 Jun 27 15:32:07.425500 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 371/749] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:07 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:07.977401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-78fb3ec2-49de-4a85-b10d-ef33d29c9295 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:07.980712 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-78fb3ec2-49de-4a85-b10d-ef33d29c9295 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:07.993028 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78fb3ec2-49de-4a85-b10d-ef33d29c9295 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:07.993608 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78fb3ec2-49de-4a85-b10d-ef33d29c9295 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:07.994487 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78fb3ec2-49de-4a85-b10d-ef33d29c9295 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:07.995354 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78fb3ec2-49de-4a85-b10d-ef33d29c9295 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:08.092695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-ba49f06e-103f-4b19-bfac-3f221fef7f91 req-b9be9073-3b5f-4ab0-9a73-cb2f6065929b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a", "name": "network-vif-deleted", "tag": "05ebe349-4d00-4c7d-9c0d-a92627d5285d"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:08.103892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-ba49f06e-103f-4b19-bfac-3f221fef7f91 req-b9be9073-3b5f-4ab0-9a73-cb2f6065929b service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:08.104826 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-ba49f06e-103f-4b19-bfac-3f221fef7f91 req-b9be9073-3b5f-4ab0-9a73-cb2f6065929b service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:08.141379 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-ba49f06e-103f-4b19-bfac-3f221fef7f91 req-b9be9073-3b5f-4ab0-9a73-cb2f6065929b service nova] Creating event network-vif-deleted:05ebe349-4d00-4c7d-9c0d-a92627d5285d for instance c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a on hv-cinder-84779 Jun 27 15:32:08.153529 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-ba49f06e-103f-4b19-bfac-3f221fef7f91 req-b9be9073-3b5f-4ab0-9a73-cb2f6065929b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.136672 Jun 27 15:32:08.154246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 372/750] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:32:08.208511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-78fb3ec2-49de-4a85-b10d-ef33d29c9295 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:08.211280 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:08.218364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-78fb3ec2-49de-4a85-b10d-ef33d29c9295 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.253016 Jun 27 15:32:08.218957 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 379/751] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:07 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:08.223066 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:08.223764 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:08.232890 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:08.233553 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:08.234655 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:08.235188 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:08.270718 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:08.271179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:08.271638 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lazy-loading 'fault' on Instance uuid c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:32:08.322383 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:08.332078 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-02680b95-ae4f-44c6-9edb-6175be24eca2 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 200 len: 1312 microversion: 2.1 time: 0.114400 Jun 27 15:32:08.332738 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 373/752] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:08 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 1312 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:08.443303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1b59d0ba-ad75-40d3-ae1d-0ab7e113fcc8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:08.444650 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1b59d0ba-ad75-40d3-ae1d-0ab7e113fcc8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:08.446902 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:08.453442 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b59d0ba-ad75-40d3-ae1d-0ab7e113fcc8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:08.453888 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b59d0ba-ad75-40d3-ae1d-0ab7e113fcc8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:08.454731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b59d0ba-ad75-40d3-ae1d-0ab7e113fcc8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:08.455462 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1b59d0ba-ad75-40d3-ae1d-0ab7e113fcc8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:08.619817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1b59d0ba-ad75-40d3-ae1d-0ab7e113fcc8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:08.629768 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1b59d0ba-ad75-40d3-ae1d-0ab7e113fcc8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1363 microversion: 2.1 time: 0.190203 Jun 27 15:32:08.630770 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 380/753] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:08 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1363 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:08.727408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-968fbab4-428d-4880-8484-436666b8bbb6 req-4e8b5089-5ba6-42cc-be2e-1d853bda2fde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3afef28-40eb-48c6-a65c-f549cc963cda", "name": "network-vif-plugged", "status": "completed", "tag": "15808846-1217-422f-a8ef-2e30bfe2ee06"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:08.739867 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-968fbab4-428d-4880-8484-436666b8bbb6 req-4e8b5089-5ba6-42cc-be2e-1d853bda2fde service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:08.740363 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-968fbab4-428d-4880-8484-436666b8bbb6 req-4e8b5089-5ba6-42cc-be2e-1d853bda2fde service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:08.756218 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-968fbab4-428d-4880-8484-436666b8bbb6 req-4e8b5089-5ba6-42cc-be2e-1d853bda2fde service nova] Creating event network-vif-plugged:15808846-1217-422f-a8ef-2e30bfe2ee06 for instance a3afef28-40eb-48c6-a65c-f549cc963cda on hv-cinder-84779 Jun 27 15:32:08.764684 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-968fbab4-428d-4880-8484-436666b8bbb6 req-4e8b5089-5ba6-42cc-be2e-1d853bda2fde service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040872 Jun 27 15:32:08.765767 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 374/754] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:32:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:09.243446 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-46015004-f490-416f-842e-3966868cfb8d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:09.244216 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-46015004-f490-416f-842e-3966868cfb8d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:09.252871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46015004-f490-416f-842e-3966868cfb8d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.253403 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46015004-f490-416f-842e-3966868cfb8d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.254189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46015004-f490-416f-842e-3966868cfb8d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.254628 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-46015004-f490-416f-842e-3966868cfb8d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.351386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5e8f9752-33b9-40f5-8fc1-b87ae3d6d7aa tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:09.354875 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5e8f9752-33b9-40f5-8fc1-b87ae3d6d7aa tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:09.376591 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5e8f9752-33b9-40f5-8fc1-b87ae3d6d7aa tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.377665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5e8f9752-33b9-40f5-8fc1-b87ae3d6d7aa tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.379769 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5e8f9752-33b9-40f5-8fc1-b87ae3d6d7aa tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.380915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5e8f9752-33b9-40f5-8fc1-b87ae3d6d7aa tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.404914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-5e8f9752-33b9-40f5-8fc1-b87ae3d6d7aa tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] HTTP exception thrown: Instance c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a could not be found. Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5e8f9752-33b9-40f5-8fc1-b87ae3d6d7aa tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Request method failure captured: Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a HTTP/1.1 Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwoSnYhPWU8-WWSH7wGBafQXIjG8xq98RxBC5ln0qY8NkV2iLRGT08tr0ASJ32aKDac2AetAJt5KEH-MB45B6tNlCKvzjpp2VxDDEmGGD9f2DWMJUawGMuLpCecS5Sr5leKkWGj1HDRn5lcOcvOa-_F1S9KTpDSmAaKp-xUVFJjM6g Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 2832173587a6494eb7f73b3ca0a09a0f Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:32:09.408103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2832173587a6494eb7f73b3ca0a09a0f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 2832173587a6494eb7f73b3ca0a09a0f Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-ServerRescueNegativeTestJSON-640731549-project Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: effe0200dc584f11923e83ed240138ff Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-ServerRescueNegativeTestJSON-640731549-project Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a could not be found. Jun 27 15:32:09.409773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a'} Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a could not be found. Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:32:09.410601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a could not be found. Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a could not be found. Jun 27 15:32:09.411815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:09.416956 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5e8f9752-33b9-40f5-8fc1-b87ae3d6d7aa tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Returning 404 to user: Instance c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:32:09.416956 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5e8f9752-33b9-40f5-8fc1-b87ae3d6d7aa tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a" status: 404 len: 111 microversion: 2.1 time: 0.065119 Jun 27 15:32:09.416956 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 375/755] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:09 2022] GET /compute/v2.1/servers/c8ed70e1-8bde-4f6a-9a3b-9ae26ce2561a => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:32:09.426538 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-46015004-f490-416f-842e-3966868cfb8d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:09.428412 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a852cad5-b4b8-4779-8c27-667a121ecd33 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:09.429387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a852cad5-b4b8-4779-8c27-667a121ecd33 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:09.440844 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a852cad5-b4b8-4779-8c27-667a121ecd33 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.441747 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a852cad5-b4b8-4779-8c27-667a121ecd33 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.441945 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-46015004-f490-416f-842e-3966868cfb8d tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.208513 Jun 27 15:32:09.442732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 381/756] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:09 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:09.443436 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a852cad5-b4b8-4779-8c27-667a121ecd33 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.444236 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a852cad5-b4b8-4779-8c27-667a121ecd33 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.475746 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a852cad5-b4b8-4779-8c27-667a121ecd33 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Going to try to terminate instance {{(pid=117977) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:32:09.559234 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a852cad5-b4b8-4779-8c27-667a121ecd33 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 204 len: 0 microversion: 2.1 time: 0.137743 Jun 27 15:32:09.559856 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 376/757] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:32:09 2022] DELETE /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:32:09.569004 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2617e7f6-b986-4fb7-95ac-714eebaf88da tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:09.569644 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2617e7f6-b986-4fb7-95ac-714eebaf88da tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:09.576516 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2617e7f6-b986-4fb7-95ac-714eebaf88da tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.576973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2617e7f6-b986-4fb7-95ac-714eebaf88da tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.577764 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2617e7f6-b986-4fb7-95ac-714eebaf88da tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.578207 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2617e7f6-b986-4fb7-95ac-714eebaf88da tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.648369 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-13a1eb12-6dad-4a63-978f-f60cfc345b9d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:09.649066 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-13a1eb12-6dad-4a63-978f-f60cfc345b9d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:09.655852 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-13a1eb12-6dad-4a63-978f-f60cfc345b9d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.656195 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-13a1eb12-6dad-4a63-978f-f60cfc345b9d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.657024 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-13a1eb12-6dad-4a63-978f-f60cfc345b9d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.657454 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-13a1eb12-6dad-4a63-978f-f60cfc345b9d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.722793 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2617e7f6-b986-4fb7-95ac-714eebaf88da tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:09.743284 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2617e7f6-b986-4fb7-95ac-714eebaf88da tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.178820 Jun 27 15:32:09.743898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 382/758] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:09 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:09.853534 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-13a1eb12-6dad-4a63-978f-f60cfc345b9d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:09.862790 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-13a1eb12-6dad-4a63-978f-f60cfc345b9d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1549 microversion: 2.1 time: 0.218548 Jun 27 15:32:09.863391 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 377/759] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:09 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1549 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:32:09.880041 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b875a826-1f58-4cd7-af2a-33c9afb504a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:09.880561 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b875a826-1f58-4cd7-af2a-33c9afb504a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:09.887074 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b875a826-1f58-4cd7-af2a-33c9afb504a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.887548 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b875a826-1f58-4cd7-af2a-33c9afb504a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.888341 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b875a826-1f58-4cd7-af2a-33c9afb504a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:09.888802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b875a826-1f58-4cd7-af2a-33c9afb504a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:09.972259 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b875a826-1f58-4cd7-af2a-33c9afb504a3 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096046 Jun 27 15:32:09.973158 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 383/760] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jun 27 15:32:09 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:32:10.459278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-12e1ee04-32c3-4bce-a1e6-551129beb166 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:10.459899 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-12e1ee04-32c3-4bce-a1e6-551129beb166 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:10.466595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-12e1ee04-32c3-4bce-a1e6-551129beb166 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:10.467045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-12e1ee04-32c3-4bce-a1e6-551129beb166 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:10.467810 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-12e1ee04-32c3-4bce-a1e6-551129beb166 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:10.468219 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-12e1ee04-32c3-4bce-a1e6-551129beb166 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:10.705312 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-12e1ee04-32c3-4bce-a1e6-551129beb166 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:10.719736 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-12e1ee04-32c3-4bce-a1e6-551129beb166 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.263763 Jun 27 15:32:10.721069 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 378/761] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:10 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:10.764211 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6353a16b-2afd-4af6-8d9b-1c4db4cf0e13 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:10.764902 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6353a16b-2afd-4af6-8d9b-1c4db4cf0e13 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:10.772491 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6353a16b-2afd-4af6-8d9b-1c4db4cf0e13 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:10.772928 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6353a16b-2afd-4af6-8d9b-1c4db4cf0e13 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:10.773718 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6353a16b-2afd-4af6-8d9b-1c4db4cf0e13 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:10.774152 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6353a16b-2afd-4af6-8d9b-1c4db4cf0e13 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:10.963423 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6353a16b-2afd-4af6-8d9b-1c4db4cf0e13 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:10.972621 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6353a16b-2afd-4af6-8d9b-1c4db4cf0e13 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.212646 Jun 27 15:32:10.973159 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 384/762] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:10 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:11.091424 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-492781c0-f5a5-466f-9188-12f70ee874af req-38acb4af-08b6-4b37-b366-9b47b3ef595f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "902ddcef-106e-4a57-a046-8ea9f13aa8a1", "tag": "08e3ae6c-5577-48e3-8481-9b2849653b64"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:11.101363 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-492781c0-f5a5-466f-9188-12f70ee874af req-38acb4af-08b6-4b37-b366-9b47b3ef595f service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:11.101867 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-492781c0-f5a5-466f-9188-12f70ee874af req-38acb4af-08b6-4b37-b366-9b47b3ef595f service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:11.115346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-492781c0-f5a5-466f-9188-12f70ee874af req-38acb4af-08b6-4b37-b366-9b47b3ef595f service nova] Creating event network-changed:08e3ae6c-5577-48e3-8481-9b2849653b64 for instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 on hv-cinder-84779 Jun 27 15:32:11.121325 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-492781c0-f5a5-466f-9188-12f70ee874af req-38acb4af-08b6-4b37-b366-9b47b3ef595f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033990 Jun 27 15:32:11.122352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 379/763] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:32:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:11.738061 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e3673771-d62d-4847-92d4-e1845a65a97a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:11.738652 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e3673771-d62d-4847-92d4-e1845a65a97a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:11.748206 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3673771-d62d-4847-92d4-e1845a65a97a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:11.749082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3673771-d62d-4847-92d4-e1845a65a97a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:11.750576 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3673771-d62d-4847-92d4-e1845a65a97a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:11.751386 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3673771-d62d-4847-92d4-e1845a65a97a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:11.899943 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e3673771-d62d-4847-92d4-e1845a65a97a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:11.910537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e3673771-d62d-4847-92d4-e1845a65a97a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.176223 Jun 27 15:32:11.911671 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 385/764] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:11 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:11.994891 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c8ac7b5d-9ed2-41ad-a832-b62217371b53 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:11.995689 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-c8ac7b5d-9ed2-41ad-a832-b62217371b53 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:12.005898 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c8ac7b5d-9ed2-41ad-a832-b62217371b53 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:12.006633 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c8ac7b5d-9ed2-41ad-a832-b62217371b53 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:12.007679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c8ac7b5d-9ed2-41ad-a832-b62217371b53 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:12.008220 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c8ac7b5d-9ed2-41ad-a832-b62217371b53 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:12.187742 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-c8ac7b5d-9ed2-41ad-a832-b62217371b53 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:12.196652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c8ac7b5d-9ed2-41ad-a832-b62217371b53 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.210123 Jun 27 15:32:12.197247 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 380/765] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:11 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:12.929437 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-35fb923b-ff56-4793-afa8-9362863487d9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:12.930059 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-35fb923b-ff56-4793-afa8-9362863487d9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:12.937518 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-35fb923b-ff56-4793-afa8-9362863487d9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:12.937968 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-35fb923b-ff56-4793-afa8-9362863487d9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:12.938748 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-35fb923b-ff56-4793-afa8-9362863487d9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:12.939178 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-35fb923b-ff56-4793-afa8-9362863487d9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:13.077265 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-35fb923b-ff56-4793-afa8-9362863487d9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:13.085318 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-35fb923b-ff56-4793-afa8-9362863487d9 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1366 microversion: 2.1 time: 0.160375 Jun 27 15:32:13.085897 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 386/766] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:12 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:13.214978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c73692af-2538-4d32-be83-774557b3ef62 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:13.216059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-c73692af-2538-4d32-be83-774557b3ef62 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:13.224711 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c73692af-2538-4d32-be83-774557b3ef62 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:13.225133 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c73692af-2538-4d32-be83-774557b3ef62 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:13.225923 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c73692af-2538-4d32-be83-774557b3ef62 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:13.226361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c73692af-2538-4d32-be83-774557b3ef62 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:13.248697 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:13.409468 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-c73692af-2538-4d32-be83-774557b3ef62 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:13.417606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c73692af-2538-4d32-be83-774557b3ef62 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.206658 Jun 27 15:32:13.418262 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 381/767] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:13 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:13.934602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea1af878-daa2-4a25-b4cd-4cbbb3871e5a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-717478751"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:13.935997 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ea1af878-daa2-4a25-b4cd-4cbbb3871e5a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:13.943579 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea1af878-daa2-4a25-b4cd-4cbbb3871e5a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:13.944292 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea1af878-daa2-4a25-b4cd-4cbbb3871e5a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:13.945548 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea1af878-daa2-4a25-b4cd-4cbbb3871e5a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:13.946268 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea1af878-daa2-4a25-b4cd-4cbbb3871e5a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:14.102591 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a105fcd6-4da4-4978-9a47-5b84ddc1c4bb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:14.103744 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a105fcd6-4da4-4978-9a47-5b84ddc1c4bb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:14.112543 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a105fcd6-4da4-4978-9a47-5b84ddc1c4bb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:14.113285 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a105fcd6-4da4-4978-9a47-5b84ddc1c4bb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:14.114307 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a105fcd6-4da4-4978-9a47-5b84ddc1c4bb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:14.115216 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a105fcd6-4da4-4978-9a47-5b84ddc1c4bb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:14.499494 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a105fcd6-4da4-4978-9a47-5b84ddc1c4bb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:14.511853 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a105fcd6-4da4-4978-9a47-5b84ddc1c4bb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1556 microversion: 2.1 time: 0.412920 Jun 27 15:32:14.525085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 382/768] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:14 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1556 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:32:14.534439 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b5b9c804-0f5d-48c4-ac57-4cc88be71dee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:14.536534 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b5b9c804-0f5d-48c4-ac57-4cc88be71dee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:14.546192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b5b9c804-0f5d-48c4-ac57-4cc88be71dee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:14.547747 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b5b9c804-0f5d-48c4-ac57-4cc88be71dee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:14.549157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b5b9c804-0f5d-48c4-ac57-4cc88be71dee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:14.550094 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b5b9c804-0f5d-48c4-ac57-4cc88be71dee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:14.572784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.network.security_group_api [None req-ea1af878-daa2-4a25-b4cd-4cbbb3871e5a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Removing security group 09e21af3-79db-4833-950a-21c92d53c1a9 from port 3ccbca6d-373a-42a6-9d88-221bb0b77dd5 Jun 27 15:32:14.778992 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b5b9c804-0f5d-48c4-ac57-4cc88be71dee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:14.789027 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b5b9c804-0f5d-48c4-ac57-4cc88be71dee tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1522 microversion: 2.1 time: 0.262145 Jun 27 15:32:14.790007 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 383/769] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:14 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:14.795940 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ed894cb4-6ef8-41a4-b070-9bb10ea1f54e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:14.796617 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ed894cb4-6ef8-41a4-b070-9bb10ea1f54e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:14.803943 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ed894cb4-6ef8-41a4-b070-9bb10ea1f54e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:14.804415 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ed894cb4-6ef8-41a4-b070-9bb10ea1f54e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:14.805195 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ed894cb4-6ef8-41a4-b070-9bb10ea1f54e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:14.805629 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ed894cb4-6ef8-41a4-b070-9bb10ea1f54e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:14.921544 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ed894cb4-6ef8-41a4-b070-9bb10ea1f54e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130018 Jun 27 15:32:14.922681 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 384/770] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jun 27 15:32:14 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-interface => generated 285 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:15.296174 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ea1af878-daa2-4a25-b4cd-4cbbb3871e5a tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "POST /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/action" status: 202 len: 0 microversion: 2.1 time: 1.366747 Jun 27 15:32:15.297703 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 387/771] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:32:13 2022] POST /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/action => generated 0 bytes in 1369 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:32:15.640774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-930c2ce2-3786-4270-90f2-da6345d98668 req-da4a689a-d0c4-4435-a19a-3938a9fe6a0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7aa7f3fe-5f45-46ca-960d-1c77079dceb6", "name": "network-vif-deleted", "tag": "6589e017-7d15-4438-86e5-e3a74e6999a7"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:15.672835 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-930c2ce2-3786-4270-90f2-da6345d98668 req-da4a689a-d0c4-4435-a19a-3938a9fe6a0d service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:15.673192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-930c2ce2-3786-4270-90f2-da6345d98668 req-da4a689a-d0c4-4435-a19a-3938a9fe6a0d service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:15.708972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-930c2ce2-3786-4270-90f2-da6345d98668 req-da4a689a-d0c4-4435-a19a-3938a9fe6a0d service nova] Creating event network-vif-deleted:6589e017-7d15-4438-86e5-e3a74e6999a7 for instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 on hv-cinder-84779 Jun 27 15:32:15.724989 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-930c2ce2-3786-4270-90f2-da6345d98668 req-da4a689a-d0c4-4435-a19a-3938a9fe6a0d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.482705 Jun 27 15:32:15.726824 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 385/772] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:32:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:15.807533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:15.808809 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:15.830086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:15.835908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:15.836953 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:15.837425 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:15.972001 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:15.972514 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:15.976115 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lazy-loading 'fault' on Instance uuid 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:32:16.092168 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'effe0200dc584f11923e83ed240138ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2832173587a6494eb7f73b3ca0a09a0f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:16.112042 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-adbd8d21-7a34-47c1-943c-4e9d33fd1811 tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 200 len: 1312 microversion: 2.1 time: 0.308800 Jun 27 15:32:16.112728 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 388/773] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:15 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 1312 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:16.619458 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-6a326cf4-1c72-4fc7-919d-c05549f1391c req-d9934964-7072-42c2-8aef-111a9b1155e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3afef28-40eb-48c6-a65c-f549cc963cda", "tag": "15808846-1217-422f-a8ef-2e30bfe2ee06"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:16.630296 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-6a326cf4-1c72-4fc7-919d-c05549f1391c req-d9934964-7072-42c2-8aef-111a9b1155e2 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:16.631120 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-6a326cf4-1c72-4fc7-919d-c05549f1391c req-d9934964-7072-42c2-8aef-111a9b1155e2 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:16.643404 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-6a326cf4-1c72-4fc7-919d-c05549f1391c req-d9934964-7072-42c2-8aef-111a9b1155e2 service nova] Creating event network-changed:15808846-1217-422f-a8ef-2e30bfe2ee06 for instance a3afef28-40eb-48c6-a65c-f549cc963cda on hv-cinder-84779 Jun 27 15:32:16.649380 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-6a326cf4-1c72-4fc7-919d-c05549f1391c req-d9934964-7072-42c2-8aef-111a9b1155e2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035437 Jun 27 15:32:16.653129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 386/774] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:32:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:17.056848 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4888a6d3-c8a5-4857-bb29-bf9742303e4b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:17.059710 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4888a6d3-c8a5-4857-bb29-bf9742303e4b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:17.067353 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4888a6d3-c8a5-4857-bb29-bf9742303e4b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:17.068177 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4888a6d3-c8a5-4857-bb29-bf9742303e4b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:17.069573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4888a6d3-c8a5-4857-bb29-bf9742303e4b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:17.070232 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4888a6d3-c8a5-4857-bb29-bf9742303e4b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:17.131100 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-be7f0aaa-d4b6-4d92-b418-6f950fed6f0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:17.132912 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-be7f0aaa-d4b6-4d92-b418-6f950fed6f0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] [instance: 7aa7f3fe-5f45-46ca-960d-1c77079dceb6] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:17.145424 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-be7f0aaa-d4b6-4d92-b418-6f950fed6f0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:17.147792 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-be7f0aaa-d4b6-4d92-b418-6f950fed6f0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:17.152287 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-be7f0aaa-d4b6-4d92-b418-6f950fed6f0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:17.153306 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-be7f0aaa-d4b6-4d92-b418-6f950fed6f0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:17.186601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-be7f0aaa-d4b6-4d92-b418-6f950fed6f0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] HTTP exception thrown: Instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 could not be found. Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-be7f0aaa-d4b6-4d92-b418-6f950fed6f0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Request method failure captured: Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 HTTP/1.1 Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwoSnYhPWU8-WWSH7wGBafQXIjG8xq98RxBC5ln0qY8NkV2iLRGT08tr0ASJ32aKDac2AetAJt5KEH-MB45B6tNlCKvzjpp2VxDDEmGGD9f2DWMJUawGMuLpCecS5Sr5leKkWGj1HDRn5lcOcvOa-_F1S9KTpDSmAaKp-xUVFJjM6g Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 2832173587a6494eb7f73b3ca0a09a0f Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:32:17.188547 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2832173587a6494eb7f73b3ca0a09a0f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2832173587a6494eb7f73b3ca0a09a0f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 2832173587a6494eb7f73b3ca0a09a0f Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-640731549 Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-ServerRescueNegativeTestJSON-640731549-project Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: effe0200dc584f11923e83ed240138ff Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-ServerRescueNegativeTestJSON-640731549-project Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 could not be found. Jun 27 15:32:17.189993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '7aa7f3fe-5f45-46ca-960d-1c77079dceb6'} Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 could not be found. Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:32:17.190694 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 could not be found. Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 could not be found. Jun 27 15:32:17.191896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:17.196107 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-be7f0aaa-d4b6-4d92-b418-6f950fed6f0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] Returning 404 to user: Instance 7aa7f3fe-5f45-46ca-960d-1c77079dceb6 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:32:17.198764 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-be7f0aaa-d4b6-4d92-b418-6f950fed6f0a tempest-ServerRescueNegativeTestJSON-640731549 tempest-ServerRescueNegativeTestJSON-640731549-project] 10.222.0.26 "GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6" status: 404 len: 111 microversion: 2.1 time: 0.072895 Jun 27 15:32:17.200053 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 387/775] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:17 2022] GET /compute/v2.1/servers/7aa7f3fe-5f45-46ca-960d-1c77079dceb6 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:32:17.216125 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-4888a6d3-c8a5-4857-bb29-bf9742303e4b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lazy-loading 'services' on Instance uuid ce5aa595-85d6-44d8-9b6a-0fd0e958657c {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:32:17.397175 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4888a6d3-c8a5-4857-bb29-bf9742303e4b tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments/8082677c-4ae6-43d5-853b-eb18e946a2f4" status: 202 len: 0 microversion: 2.1 time: 0.341985 Jun 27 15:32:17.397853 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 389/776] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:32:17 2022] DELETE /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments/8082677c-4ae6-43d5-853b-eb18e946a2f4 => generated 0 bytes in 347 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:32:17.407276 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3deb2f5c-9493-495e-9f5a-76eaddd3cee4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:17.408775 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3deb2f5c-9493-495e-9f5a-76eaddd3cee4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:17.420762 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3deb2f5c-9493-495e-9f5a-76eaddd3cee4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:17.422878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3deb2f5c-9493-495e-9f5a-76eaddd3cee4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:17.424447 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3deb2f5c-9493-495e-9f5a-76eaddd3cee4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:17.426782 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3deb2f5c-9493-495e-9f5a-76eaddd3cee4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:17.493896 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3deb2f5c-9493-495e-9f5a-76eaddd3cee4 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.091359 Jun 27 15:32:17.497522 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 388/777] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:32:17 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments => generated 197 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:17.780697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-a644623b-ccf1-4927-8bb3-3075b43da350 req-c1122e4d-49a7-4893-b0ad-f516bbe856a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ce5aa595-85d6-44d8-9b6a-0fd0e958657c", "tag": "3ccbca6d-373a-42a6-9d88-221bb0b77dd5"}, {"name": "network-changed", "server_uuid": "ce5aa595-85d6-44d8-9b6a-0fd0e958657c", "tag": "3ccbca6d-373a-42a6-9d88-221bb0b77dd5"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:17.790469 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a644623b-ccf1-4927-8bb3-3075b43da350 req-c1122e4d-49a7-4893-b0ad-f516bbe856a8 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:17.791241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a644623b-ccf1-4927-8bb3-3075b43da350 req-c1122e4d-49a7-4893-b0ad-f516bbe856a8 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:17.806942 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-a644623b-ccf1-4927-8bb3-3075b43da350 req-c1122e4d-49a7-4893-b0ad-f516bbe856a8 service nova] Creating event network-changed:3ccbca6d-373a-42a6-9d88-221bb0b77dd5 for instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c on hv-cinder-84779 Jun 27 15:32:17.809331 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-a644623b-ccf1-4927-8bb3-3075b43da350 req-c1122e4d-49a7-4893-b0ad-f516bbe856a8 service nova] Creating event network-changed:3ccbca6d-373a-42a6-9d88-221bb0b77dd5 for instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c on hv-cinder-84779 Jun 27 15:32:17.815571 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-a644623b-ccf1-4927-8bb3-3075b43da350 req-c1122e4d-49a7-4893-b0ad-f516bbe856a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.038902 Jun 27 15:32:17.816933 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 390/778] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:32:17 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:18.510230 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a6b9b17d-ccb7-4e9a-b2e5-bdbe1a051b22 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:18.512497 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a6b9b17d-ccb7-4e9a-b2e5-bdbe1a051b22 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:18.527898 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a6b9b17d-ccb7-4e9a-b2e5-bdbe1a051b22 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:18.528618 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a6b9b17d-ccb7-4e9a-b2e5-bdbe1a051b22 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:18.533563 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a6b9b17d-ccb7-4e9a-b2e5-bdbe1a051b22 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:18.535248 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a6b9b17d-ccb7-4e9a-b2e5-bdbe1a051b22 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:18.574576 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a6b9b17d-ccb7-4e9a-b2e5-bdbe1a051b22 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.069011 Jun 27 15:32:18.580822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 389/779] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:32:18 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:32:18.587085 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ef0dc3bb-404a-4510-be3d-f087861a8b69 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:18.587910 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ef0dc3bb-404a-4510-be3d-f087861a8b69 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:18.602818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef0dc3bb-404a-4510-be3d-f087861a8b69 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:18.604108 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef0dc3bb-404a-4510-be3d-f087861a8b69 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:18.605676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef0dc3bb-404a-4510-be3d-f087861a8b69 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:18.606521 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ef0dc3bb-404a-4510-be3d-f087861a8b69 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:18.716938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-ef0dc3bb-404a-4510-be3d-f087861a8b69 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] HTTP exception thrown: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c is not attached to volume 8082677c-4ae6-43d5-853b-eb18e946a2f4 Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ef0dc3bb-404a-4510-be3d-f087861a8b69 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Request method failure captured: Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments/8082677c-4ae6-43d5-853b-eb18e946a2f4 HTTP/1.1 Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucyVkX7-AXTlHz0ttPMPlfOvdAoJH7pDkPjz01FRtVsXTIuXK-zHO3M0nX3JPeD55JuVpFyCXKJUokmd477pkL8XOy6bwY93APMGtZM3UT0Ynasf-girlb7NSuwEUstvi-bYBiZcTI0p2ORarYg730-wMnXpzImGi0mmpsyaSAPQL4w Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 52c96385e67941648eee6bf532b3f141 Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-TestMinimumBasicScenario-2141702602 Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:32:18.728843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_52c96385e67941648eee6bf532b3f141", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/52c96385e67941648eee6bf532b3f141"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c96385e67941648eee6bf532b3f141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c96385e67941648eee6bf532b3f141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-TestMinimumBasicScenario-2141702602 Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 52c96385e67941648eee6bf532b3f141 Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2141702602 Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-TestMinimumBasicScenario-2141702602-project Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: d6682b6bd10a4609b68db0bd02f193b6 Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-TestMinimumBasicScenario-2141702602-project Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:32:18.730504 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c is not attached to volume 8082677c-4ae6-43d5-853b-eb18e946a2f4 Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'server_id': 'ce5aa595-85d6-44d8-9b6a-0fd0e958657c', 'id': '8082677c-4ae6-43d5-853b-eb18e946a2f4'} Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 8082677c-4ae6-43d5-853b-eb18e946a2f4. Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:32:18.731370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c is not attached to volume 8082677c-4ae6-43d5-853b-eb18e946a2f4 Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c is not attached to volume 8082677c-4ae6-43d5-853b-eb18e946a2f4 Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:32:18.732735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ef0dc3bb-404a-4510-be3d-f087861a8b69 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Returning 404 to user: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c is not attached to volume 8082677c-4ae6-43d5-853b-eb18e946a2f4 {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:32:18.733751 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ef0dc3bb-404a-4510-be3d-f087861a8b69 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments/8082677c-4ae6-43d5-853b-eb18e946a2f4" status: 404 len: 154 microversion: 2.1 time: 0.150298 Jun 27 15:32:18.734156 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 391/780] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:32:18 2022] DELETE /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c/os-volume_attachments/8082677c-4ae6-43d5-853b-eb18e946a2f4 => generated 154 bytes in 153 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:32:19.990631 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-50fb86fe-2d4f-46bb-96cb-2350ec08ae2e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:19.991226 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-50fb86fe-2d4f-46bb-96cb-2350ec08ae2e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:20.000058 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-50fb86fe-2d4f-46bb-96cb-2350ec08ae2e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:20.001374 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-50fb86fe-2d4f-46bb-96cb-2350ec08ae2e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:20.002264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-50fb86fe-2d4f-46bb-96cb-2350ec08ae2e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:20.002772 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-50fb86fe-2d4f-46bb-96cb-2350ec08ae2e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:20.032922 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-50fb86fe-2d4f-46bb-96cb-2350ec08ae2e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Going to try to terminate instance {{(pid=117977) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:32:20.146760 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:20.157817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-50fb86fe-2d4f-46bb-96cb-2350ec08ae2e tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 204 len: 0 microversion: 2.1 time: 0.171435 Jun 27 15:32:20.158613 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 390/781] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:32:19 2022] DELETE /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 0 bytes in 173 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:32:20.168025 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b7414c30-7387-4237-86e4-6305dbbe2795 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:20.169360 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b7414c30-7387-4237-86e4-6305dbbe2795 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:20.177339 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7414c30-7387-4237-86e4-6305dbbe2795 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:20.177801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7414c30-7387-4237-86e4-6305dbbe2795 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:20.179711 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7414c30-7387-4237-86e4-6305dbbe2795 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:20.181146 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b7414c30-7387-4237-86e4-6305dbbe2795 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:20.371707 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b7414c30-7387-4237-86e4-6305dbbe2795 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:20.383019 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b7414c30-7387-4237-86e4-6305dbbe2795 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1553 microversion: 2.1 time: 0.219445 Jun 27 15:32:20.383882 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 392/782] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:20 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1553 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:32:21.404417 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2a232398-f716-46a3-a15d-5aab85aa1e42 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:21.405903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2a232398-f716-46a3-a15d-5aab85aa1e42 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:21.417853 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2a232398-f716-46a3-a15d-5aab85aa1e42 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:21.420016 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2a232398-f716-46a3-a15d-5aab85aa1e42 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:21.421989 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2a232398-f716-46a3-a15d-5aab85aa1e42 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:21.422819 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2a232398-f716-46a3-a15d-5aab85aa1e42 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:21.701023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2a232398-f716-46a3-a15d-5aab85aa1e42 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:21.709156 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2a232398-f716-46a3-a15d-5aab85aa1e42 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1553 microversion: 2.1 time: 0.309770 Jun 27 15:32:21.710040 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 391/783] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:21 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1553 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:22.738737 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8151f245-9d63-4f37-b62d-dacfed2eb8ce tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:22.740815 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8151f245-9d63-4f37-b62d-dacfed2eb8ce tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:22.750893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8151f245-9d63-4f37-b62d-dacfed2eb8ce tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:22.751865 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8151f245-9d63-4f37-b62d-dacfed2eb8ce tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:22.753463 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8151f245-9d63-4f37-b62d-dacfed2eb8ce tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:22.754278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8151f245-9d63-4f37-b62d-dacfed2eb8ce tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:22.898396 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-0c010bc1-8fa8-4b6a-bfa4-92d31f4f17ed req-0a3eb1c0-0bd4-496a-b50b-cf7884c816c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ce5aa595-85d6-44d8-9b6a-0fd0e958657c", "name": "network-vif-deleted", "tag": "3ccbca6d-373a-42a6-9d88-221bb0b77dd5"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:22.911924 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-0c010bc1-8fa8-4b6a-bfa4-92d31f4f17ed req-0a3eb1c0-0bd4-496a-b50b-cf7884c816c6 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:22.912375 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-0c010bc1-8fa8-4b6a-bfa4-92d31f4f17ed req-0a3eb1c0-0bd4-496a-b50b-cf7884c816c6 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:22.927693 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-0c010bc1-8fa8-4b6a-bfa4-92d31f4f17ed req-0a3eb1c0-0bd4-496a-b50b-cf7884c816c6 service nova] Creating event network-vif-deleted:3ccbca6d-373a-42a6-9d88-221bb0b77dd5 for instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c on hv-cinder-84779 Jun 27 15:32:22.934463 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-0c010bc1-8fa8-4b6a-bfa4-92d31f4f17ed req-0a3eb1c0-0bd4-496a-b50b-cf7884c816c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039621 Jun 27 15:32:22.935723 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 392/784] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:32:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:22.937796 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8151f245-9d63-4f37-b62d-dacfed2eb8ce tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6682b6bd10a4609b68db0bd02f193b6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '52c96385e67941648eee6bf532b3f141', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:22.952517 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8151f245-9d63-4f37-b62d-dacfed2eb8ce tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 200 len: 1511 microversion: 2.1 time: 0.222549 Jun 27 15:32:22.966396 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 393/785] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:22 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:32:23.970270 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3da26ff8-1177-472f-a8bf-ef13f75ec9c8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:23.971006 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3da26ff8-1177-472f-a8bf-ef13f75ec9c8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] [instance: ce5aa595-85d6-44d8-9b6a-0fd0e958657c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:23.977832 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3da26ff8-1177-472f-a8bf-ef13f75ec9c8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:23.978283 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3da26ff8-1177-472f-a8bf-ef13f75ec9c8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:23.979121 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3da26ff8-1177-472f-a8bf-ef13f75ec9c8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:23.979582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3da26ff8-1177-472f-a8bf-ef13f75ec9c8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:23.994652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-3da26ff8-1177-472f-a8bf-ef13f75ec9c8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] HTTP exception thrown: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c could not be found. Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3da26ff8-1177-472f-a8bf-ef13f75ec9c8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Request method failure captured: Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c HTTP/1.1 Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucyVkX7-AXTlHz0ttPMPlfOvdAoJH7pDkPjz01FRtVsXTIuXK-zHO3M0nX3JPeD55JuVpFyCXKJUokmd477pkL8XOy6bwY93APMGtZM3UT0Ynasf-girlb7NSuwEUstvi-bYBiZcTI0p2ORarYg730-wMnXpzImGi0mmpsyaSAPQL4w Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 52c96385e67941648eee6bf532b3f141 Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-TestMinimumBasicScenario-2141702602 Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:32:23.996335 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_52c96385e67941648eee6bf532b3f141", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/52c96385e67941648eee6bf532b3f141"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c96385e67941648eee6bf532b3f141"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/52c96385e67941648eee6bf532b3f141"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-TestMinimumBasicScenario-2141702602 Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 52c96385e67941648eee6bf532b3f141 Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2141702602 Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-TestMinimumBasicScenario-2141702602-project Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: d6682b6bd10a4609b68db0bd02f193b6 Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-TestMinimumBasicScenario-2141702602-project Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c could not be found. Jun 27 15:32:23.997817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'ce5aa595-85d6-44d8-9b6a-0fd0e958657c'} Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c could not be found. Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:32:23.998593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c could not be found. Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c could not be found. Jun 27 15:32:23.999755 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:32:24.000895 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3da26ff8-1177-472f-a8bf-ef13f75ec9c8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Returning 404 to user: Instance ce5aa595-85d6-44d8-9b6a-0fd0e958657c could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:32:24.000895 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3da26ff8-1177-472f-a8bf-ef13f75ec9c8 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c" status: 404 len: 111 microversion: 2.1 time: 0.032292 Jun 27 15:32:24.000895 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 393/786] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:32:23 2022] GET /compute/v2.1/servers/ce5aa595-85d6-44d8-9b6a-0fd0e958657c => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:32:24.007602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-21b667e2-13dd-48d2-bb7c-ca9f2d2c5787 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] Calling method '.version_select at 0x7fb2733c1940>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:24.028761 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-21b667e2-13dd-48d2-bb7c-ca9f2d2c5787 tempest-TestMinimumBasicScenario-2141702602 tempest-TestMinimumBasicScenario-2141702602-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-803733481" status: 202 len: 0 microversion: 2.1 time: 0.025769 Jun 27 15:32:24.029558 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 394/787] 10.222.0.26 () {58 vars in 1268 bytes} [Mon Jun 27 15:32:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-803733481 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:32:30.243661 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-905e9a6b-4997-4f12-98c9-77e733b250f0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:30.244821 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-905e9a6b-4997-4f12-98c9-77e733b250f0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:30.251397 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-905e9a6b-4997-4f12-98c9-77e733b250f0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:30.252389 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-905e9a6b-4997-4f12-98c9-77e733b250f0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:30.253243 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-905e9a6b-4997-4f12-98c9-77e733b250f0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:30.253681 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-905e9a6b-4997-4f12-98c9-77e733b250f0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:30.294246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-905e9a6b-4997-4f12-98c9-77e733b250f0 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/ips" status: 200 len: 152 microversion: 2.20 time: 0.055362 Jun 27 15:32:30.302657 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 394/788] 10.222.0.26 () {60 vars in 1288 bytes} [Mon Jun 27 15:32:30 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/ips => generated 152 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:32:32.233598 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cfb8ba3a-7b16-4f47-a796-9a453d51a154 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:32.234364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cfb8ba3a-7b16-4f47-a796-9a453d51a154 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:32.245117 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cfb8ba3a-7b16-4f47-a796-9a453d51a154 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:32.245572 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cfb8ba3a-7b16-4f47-a796-9a453d51a154 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:32.246459 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cfb8ba3a-7b16-4f47-a796-9a453d51a154 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:32.246896 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cfb8ba3a-7b16-4f47-a796-9a453d51a154 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:32.281122 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-cfb8ba3a-7b16-4f47-a796-9a453d51a154 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lazy-loading 'flavor' on Instance uuid 886a9b39-9d64-4359-8d03-b07dbe1abf9c {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:32:32.368151 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:32.596135 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cfb8ba3a-7b16-4f47-a796-9a453d51a154 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "POST /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/action" status: 202 len: 0 microversion: 2.20 time: 0.369679 Jun 27 15:32:32.598631 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 395/789] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jun 27 15:32:32 2022] POST /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/action => generated 0 bytes in 375 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:32:32.608501 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3073577f-9879-4106-b1f6-25f1e42f9592 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:32.609661 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3073577f-9879-4106-b1f6-25f1e42f9592 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:32.618220 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3073577f-9879-4106-b1f6-25f1e42f9592 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:32.618762 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3073577f-9879-4106-b1f6-25f1e42f9592 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:32.620069 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3073577f-9879-4106-b1f6-25f1e42f9592 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:32.620637 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3073577f-9879-4106-b1f6-25f1e42f9592 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:32.866531 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3073577f-9879-4106-b1f6-25f1e42f9592 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:32.875481 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3073577f-9879-4106-b1f6-25f1e42f9592 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:32.877087 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3073577f-9879-4106-b1f6-25f1e42f9592 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:32.878397 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3073577f-9879-4106-b1f6-25f1e42f9592 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.273922 Jun 27 15:32:32.879020 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 395/790] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:32 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:33.898527 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0f8c6d22-133a-497e-8fcd-d8bcc4b38107 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:33.899365 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0f8c6d22-133a-497e-8fcd-d8bcc4b38107 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:33.906949 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f8c6d22-133a-497e-8fcd-d8bcc4b38107 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:33.907390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f8c6d22-133a-497e-8fcd-d8bcc4b38107 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:33.909860 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f8c6d22-133a-497e-8fcd-d8bcc4b38107 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:33.910540 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f8c6d22-133a-497e-8fcd-d8bcc4b38107 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:34.164375 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0f8c6d22-133a-497e-8fcd-d8bcc4b38107 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:34.173149 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0f8c6d22-133a-497e-8fcd-d8bcc4b38107 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:34.175562 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0f8c6d22-133a-497e-8fcd-d8bcc4b38107 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:34.176869 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0f8c6d22-133a-497e-8fcd-d8bcc4b38107 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.282791 Jun 27 15:32:34.177414 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 396/791] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:33 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:35.206484 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b0a09693-545a-4feb-bec3-17ceff100292 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:35.207759 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b0a09693-545a-4feb-bec3-17ceff100292 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:35.219411 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b0a09693-545a-4feb-bec3-17ceff100292 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:35.220119 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b0a09693-545a-4feb-bec3-17ceff100292 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:35.221684 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b0a09693-545a-4feb-bec3-17ceff100292 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:35.222580 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b0a09693-545a-4feb-bec3-17ceff100292 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:35.775233 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b0a09693-545a-4feb-bec3-17ceff100292 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:35.790056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b0a09693-545a-4feb-bec3-17ceff100292 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:35.793517 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b0a09693-545a-4feb-bec3-17ceff100292 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:35.795154 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b0a09693-545a-4feb-bec3-17ceff100292 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.595329 Jun 27 15:32:35.796815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 396/792] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:35 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:36.819763 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5eaeb611-ca3b-42b4-9093-8f61837b42b5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:36.820494 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5eaeb611-ca3b-42b4-9093-8f61837b42b5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:36.829503 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5eaeb611-ca3b-42b4-9093-8f61837b42b5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:36.830070 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5eaeb611-ca3b-42b4-9093-8f61837b42b5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:36.831429 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5eaeb611-ca3b-42b4-9093-8f61837b42b5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:36.832191 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5eaeb611-ca3b-42b4-9093-8f61837b42b5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:36.999303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5eaeb611-ca3b-42b4-9093-8f61837b42b5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:37.008993 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5eaeb611-ca3b-42b4-9093-8f61837b42b5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:37.010560 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5eaeb611-ca3b-42b4-9093-8f61837b42b5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:37.011814 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5eaeb611-ca3b-42b4-9093-8f61837b42b5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.196139 Jun 27 15:32:37.012406 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 397/793] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:36 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:38.038005 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5b8d9ef9-e303-41a2-89b6-55345b7b920a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:38.038808 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5b8d9ef9-e303-41a2-89b6-55345b7b920a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:38.046303 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b8d9ef9-e303-41a2-89b6-55345b7b920a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:38.046861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b8d9ef9-e303-41a2-89b6-55345b7b920a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:38.047799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b8d9ef9-e303-41a2-89b6-55345b7b920a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:38.048419 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b8d9ef9-e303-41a2-89b6-55345b7b920a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:38.251719 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b8d9ef9-e303-41a2-89b6-55345b7b920a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:38.262364 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b8d9ef9-e303-41a2-89b6-55345b7b920a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:38.264213 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b8d9ef9-e303-41a2-89b6-55345b7b920a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:38.266211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5b8d9ef9-e303-41a2-89b6-55345b7b920a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.232199 Jun 27 15:32:38.267011 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 397/794] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:38 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:39.290050 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dbd6a6d1-2650-4d11-97b2-2cc6563bface tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:39.290985 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dbd6a6d1-2650-4d11-97b2-2cc6563bface tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:39.293619 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=39,nova_api:DELETE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:39.305363 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbd6a6d1-2650-4d11-97b2-2cc6563bface tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:39.307057 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbd6a6d1-2650-4d11-97b2-2cc6563bface tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:39.309519 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbd6a6d1-2650-4d11-97b2-2cc6563bface tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:39.310690 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbd6a6d1-2650-4d11-97b2-2cc6563bface tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:39.539371 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dbd6a6d1-2650-4d11-97b2-2cc6563bface tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:39.553540 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dbd6a6d1-2650-4d11-97b2-2cc6563bface tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:39.556220 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dbd6a6d1-2650-4d11-97b2-2cc6563bface tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:39.558687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dbd6a6d1-2650-4d11-97b2-2cc6563bface tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.272828 Jun 27 15:32:39.559552 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 398/795] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:39 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:40.579356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ec30e82e-500b-4133-b548-862a4da7c672 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:40.580155 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ec30e82e-500b-4133-b548-862a4da7c672 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:40.587806 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ec30e82e-500b-4133-b548-862a4da7c672 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:40.588283 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ec30e82e-500b-4133-b548-862a4da7c672 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:40.589178 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ec30e82e-500b-4133-b548-862a4da7c672 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:40.589620 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ec30e82e-500b-4133-b548-862a4da7c672 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:40.763999 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ec30e82e-500b-4133-b548-862a4da7c672 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:40.772518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ec30e82e-500b-4133-b548-862a4da7c672 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:40.774012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ec30e82e-500b-4133-b548-862a4da7c672 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:40.775190 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ec30e82e-500b-4133-b548-862a4da7c672 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.199924 Jun 27 15:32:40.776089 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 398/796] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:40 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:41.794838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9818a512-d071-40d9-a820-366e8b6d7692 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:41.795483 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9818a512-d071-40d9-a820-366e8b6d7692 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:41.802602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9818a512-d071-40d9-a820-366e8b6d7692 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:41.803062 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9818a512-d071-40d9-a820-366e8b6d7692 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:41.803877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9818a512-d071-40d9-a820-366e8b6d7692 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:41.804385 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9818a512-d071-40d9-a820-366e8b6d7692 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:41.978164 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9818a512-d071-40d9-a820-366e8b6d7692 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:41.991148 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9818a512-d071-40d9-a820-366e8b6d7692 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:41.992895 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9818a512-d071-40d9-a820-366e8b6d7692 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:41.994123 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9818a512-d071-40d9-a820-366e8b6d7692 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.204164 Jun 27 15:32:41.994757 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 399/797] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:41 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:43.016411 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-89b54c02-bf48-4a35-bbe7-b30634c57d51 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:43.017621 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-89b54c02-bf48-4a35-bbe7-b30634c57d51 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:43.025871 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-89b54c02-bf48-4a35-bbe7-b30634c57d51 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:43.026443 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-89b54c02-bf48-4a35-bbe7-b30634c57d51 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:43.027229 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-89b54c02-bf48-4a35-bbe7-b30634c57d51 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:43.027663 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-89b54c02-bf48-4a35-bbe7-b30634c57d51 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:43.183620 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-89b54c02-bf48-4a35-bbe7-b30634c57d51 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:43.209515 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-89b54c02-bf48-4a35-bbe7-b30634c57d51 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:43.211210 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-89b54c02-bf48-4a35-bbe7-b30634c57d51 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:43.212682 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-89b54c02-bf48-4a35-bbe7-b30634c57d51 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1744 microversion: 2.20 time: 0.202579 Jun 27 15:32:43.213445 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 399/798] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:43 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1744 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:44.238476 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0058989d-d38d-4e3e-9b23-75096208ba76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:44.239518 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0058989d-d38d-4e3e-9b23-75096208ba76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:44.249345 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0058989d-d38d-4e3e-9b23-75096208ba76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:44.250027 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0058989d-d38d-4e3e-9b23-75096208ba76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:44.254210 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0058989d-d38d-4e3e-9b23-75096208ba76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:44.254210 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0058989d-d38d-4e3e-9b23-75096208ba76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:44.425160 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0058989d-d38d-4e3e-9b23-75096208ba76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:44.434209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0058989d-d38d-4e3e-9b23-75096208ba76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:44.435760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0058989d-d38d-4e3e-9b23-75096208ba76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:44.436995 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0058989d-d38d-4e3e-9b23-75096208ba76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1744 microversion: 2.20 time: 0.204309 Jun 27 15:32:44.437927 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 400/799] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:44 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1744 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:45.458882 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2566d056-cb9a-491c-9efa-72878a477442 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:45.459461 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2566d056-cb9a-491c-9efa-72878a477442 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:45.466690 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2566d056-cb9a-491c-9efa-72878a477442 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:45.467130 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2566d056-cb9a-491c-9efa-72878a477442 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:45.468280 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2566d056-cb9a-491c-9efa-72878a477442 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:45.469127 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2566d056-cb9a-491c-9efa-72878a477442 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:45.477170 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:45.645707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2566d056-cb9a-491c-9efa-72878a477442 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:45.655117 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2566d056-cb9a-491c-9efa-72878a477442 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:45.656998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2566d056-cb9a-491c-9efa-72878a477442 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:45.658298 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2566d056-cb9a-491c-9efa-72878a477442 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1744 microversion: 2.20 time: 0.203870 Jun 27 15:32:45.659094 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 400/800] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:45 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1744 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:46.680704 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bf7aee58-760a-4f2f-9c93-eebbecc03af7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:46.681495 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bf7aee58-760a-4f2f-9c93-eebbecc03af7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:46.689245 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bf7aee58-760a-4f2f-9c93-eebbecc03af7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:46.689694 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bf7aee58-760a-4f2f-9c93-eebbecc03af7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:46.690468 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bf7aee58-760a-4f2f-9c93-eebbecc03af7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:46.691299 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bf7aee58-760a-4f2f-9c93-eebbecc03af7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:46.858040 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bf7aee58-760a-4f2f-9c93-eebbecc03af7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:46.867270 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bf7aee58-760a-4f2f-9c93-eebbecc03af7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:46.868828 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-bf7aee58-760a-4f2f-9c93-eebbecc03af7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:46.870181 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bf7aee58-760a-4f2f-9c93-eebbecc03af7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1744 microversion: 2.20 time: 0.193572 Jun 27 15:32:46.870728 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 401/801] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:46 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1744 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:47.569741 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a63451d8-a149-4313-a55b-804bc98a89db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:47.570362 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a63451d8-a149-4313-a55b-804bc98a89db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:47.576933 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a63451d8-a149-4313-a55b-804bc98a89db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:47.577389 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a63451d8-a149-4313-a55b-804bc98a89db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:47.578173 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a63451d8-a149-4313-a55b-804bc98a89db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:47.578610 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a63451d8-a149-4313-a55b-804bc98a89db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:47.605904 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a63451d8-a149-4313-a55b-804bc98a89db tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/ips" status: 200 len: 146 microversion: 2.1 time: 0.040200 Jun 27 15:32:47.606493 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 401/802] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jun 27 15:32:47 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:47.905221 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4d38c791-c35b-4265-a8bd-4a1137b16407 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:47.924212 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4d38c791-c35b-4265-a8bd-4a1137b16407 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:47.951051 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d38c791-c35b-4265-a8bd-4a1137b16407 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:47.954098 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d38c791-c35b-4265-a8bd-4a1137b16407 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:47.955839 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d38c791-c35b-4265-a8bd-4a1137b16407 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:47.957088 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d38c791-c35b-4265-a8bd-4a1137b16407 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:48.208986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4d38c791-c35b-4265-a8bd-4a1137b16407 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:48.220556 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4d38c791-c35b-4265-a8bd-4a1137b16407 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:48.224217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4d38c791-c35b-4265-a8bd-4a1137b16407 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:48.225669 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4d38c791-c35b-4265-a8bd-4a1137b16407 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1739 microversion: 2.20 time: 0.338630 Jun 27 15:32:48.236881 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 402/803] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:47 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1739 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:49.102671 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-af0bfc9f-b6a3-493e-831e-7a4bf46ed5fc tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d508b240-8049-4d68-8cfc-b03332f8ff4c"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:49.105000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-af0bfc9f-b6a3-493e-831e-7a4bf46ed5fc tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:49.109905 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-69753274-1788-4508-b672-3b9437d07dee req-041f75d7-8f5b-441e-bf91-0cb1d2d027d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886a9b39-9d64-4359-8d03-b07dbe1abf9c", "name": "network-vif-plugged", "status": "completed", "tag": "82ee23e2-cf54-4c80-aa3a-825aa5c81193"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:49.113589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af0bfc9f-b6a3-493e-831e-7a4bf46ed5fc tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:49.114532 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af0bfc9f-b6a3-493e-831e-7a4bf46ed5fc tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:49.116220 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af0bfc9f-b6a3-493e-831e-7a4bf46ed5fc tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:49.125345 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-af0bfc9f-b6a3-493e-831e-7a4bf46ed5fc tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:49.135361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-69753274-1788-4508-b672-3b9437d07dee req-041f75d7-8f5b-441e-bf91-0cb1d2d027d9 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:49.144277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-69753274-1788-4508-b672-3b9437d07dee req-041f75d7-8f5b-441e-bf91-0cb1d2d027d9 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:49.168136 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-69753274-1788-4508-b672-3b9437d07dee req-041f75d7-8f5b-441e-bf91-0cb1d2d027d9 service nova] Creating event network-vif-plugged:82ee23e2-cf54-4c80-aa3a-825aa5c81193 for instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c on hv-cinder-84779 Jun 27 15:32:49.186347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-69753274-1788-4508-b672-3b9437d07dee req-041f75d7-8f5b-441e-bf91-0cb1d2d027d9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.357835 Jun 27 15:32:49.186347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 402/804] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:32:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:49.245968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fc973762-26c3-4a3e-8a4e-b26c697b14b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:49.247091 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-fc973762-26c3-4a3e-8a4e-b26c697b14b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:49.257215 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fc973762-26c3-4a3e-8a4e-b26c697b14b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:49.258114 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fc973762-26c3-4a3e-8a4e-b26c697b14b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:49.259169 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fc973762-26c3-4a3e-8a4e-b26c697b14b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:49.260005 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fc973762-26c3-4a3e-8a4e-b26c697b14b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:49.467354 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fc973762-26c3-4a3e-8a4e-b26c697b14b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:49.477219 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fc973762-26c3-4a3e-8a4e-b26c697b14b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:49.480663 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fc973762-26c3-4a3e-8a4e-b26c697b14b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:49.482020 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fc973762-26c3-4a3e-8a4e-b26c697b14b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1739 microversion: 2.20 time: 0.241738 Jun 27 15:32:49.494149 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 403/805] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:49 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:32:49.528652 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-af0bfc9f-b6a3-493e-831e-7a4bf46ed5fc tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.430925 Jun 27 15:32:49.529460 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 403/806] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:32:49 2022] POST /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments => generated 194 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:50.501852 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d4f5c8f2-de69-42ef-ba8e-b5a4c34a3679 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:50.503091 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d4f5c8f2-de69-42ef-ba8e-b5a4c34a3679 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:50.512429 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4f5c8f2-de69-42ef-ba8e-b5a4c34a3679 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:50.513198 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4f5c8f2-de69-42ef-ba8e-b5a4c34a3679 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:50.513980 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4f5c8f2-de69-42ef-ba8e-b5a4c34a3679 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:50.514412 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4f5c8f2-de69-42ef-ba8e-b5a4c34a3679 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:50.747259 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d4f5c8f2-de69-42ef-ba8e-b5a4c34a3679 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:50.760536 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d4f5c8f2-de69-42ef-ba8e-b5a4c34a3679 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:50.762482 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d4f5c8f2-de69-42ef-ba8e-b5a4c34a3679 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:50.764245 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d4f5c8f2-de69-42ef-ba8e-b5a4c34a3679 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1739 microversion: 2.20 time: 0.266467 Jun 27 15:32:50.765065 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 404/807] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:50 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:51.794936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9887b17e-8acd-4b1e-bba5-8b7aae9d594c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:51.799903 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9887b17e-8acd-4b1e-bba5-8b7aae9d594c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:51.824270 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9887b17e-8acd-4b1e-bba5-8b7aae9d594c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:51.827212 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9887b17e-8acd-4b1e-bba5-8b7aae9d594c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:51.831623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9887b17e-8acd-4b1e-bba5-8b7aae9d594c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:51.832764 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9887b17e-8acd-4b1e-bba5-8b7aae9d594c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:52.202221 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9887b17e-8acd-4b1e-bba5-8b7aae9d594c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:52.223256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9887b17e-8acd-4b1e-bba5-8b7aae9d594c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:52.227092 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9887b17e-8acd-4b1e-bba5-8b7aae9d594c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:52.229342 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9887b17e-8acd-4b1e-bba5-8b7aae9d594c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1739 microversion: 2.20 time: 0.445249 Jun 27 15:32:52.230375 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 404/808] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:51 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1739 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:53.269684 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a8289def-fba1-4079-8f0b-0aef23913077 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:53.271762 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a8289def-fba1-4079-8f0b-0aef23913077 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:53.285939 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=30 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:32:53.302700 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8289def-fba1-4079-8f0b-0aef23913077 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:53.303055 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8289def-fba1-4079-8f0b-0aef23913077 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:53.303944 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8289def-fba1-4079-8f0b-0aef23913077 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:53.305408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a8289def-fba1-4079-8f0b-0aef23913077 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:53.506469 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a8289def-fba1-4079-8f0b-0aef23913077 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:53.517534 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a8289def-fba1-4079-8f0b-0aef23913077 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:53.519425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a8289def-fba1-4079-8f0b-0aef23913077 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:53.521115 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a8289def-fba1-4079-8f0b-0aef23913077 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1739 microversion: 2.20 time: 0.262286 Jun 27 15:32:53.521720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 405/809] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:53 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1739 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:54.554543 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f66276ff-0853-4213-82a3-ec9cbb4c81ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:54.555465 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f66276ff-0853-4213-82a3-ec9cbb4c81ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:54.577063 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f66276ff-0853-4213-82a3-ec9cbb4c81ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:54.577063 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f66276ff-0853-4213-82a3-ec9cbb4c81ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:54.577063 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f66276ff-0853-4213-82a3-ec9cbb4c81ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:54.577063 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f66276ff-0853-4213-82a3-ec9cbb4c81ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:54.759022 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f66276ff-0853-4213-82a3-ec9cbb4c81ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:54.772717 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f66276ff-0853-4213-82a3-ec9cbb4c81ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:54.774245 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f66276ff-0853-4213-82a3-ec9cbb4c81ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:54.775484 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f66276ff-0853-4213-82a3-ec9cbb4c81ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1739 microversion: 2.20 time: 0.225368 Jun 27 15:32:54.776038 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 405/810] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:54 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1739 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:55.796294 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-39ca7d84-83b1-452d-a9db-053542a41337 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:55.797018 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-39ca7d84-83b1-452d-a9db-053542a41337 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:55.813962 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-39ca7d84-83b1-452d-a9db-053542a41337 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:55.814480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-39ca7d84-83b1-452d-a9db-053542a41337 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:55.817860 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-39ca7d84-83b1-452d-a9db-053542a41337 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:55.818544 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-39ca7d84-83b1-452d-a9db-053542a41337 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:56.010840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-39ca7d84-83b1-452d-a9db-053542a41337 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:56.025172 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-39ca7d84-83b1-452d-a9db-053542a41337 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:56.027605 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-39ca7d84-83b1-452d-a9db-053542a41337 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:56.029501 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-39ca7d84-83b1-452d-a9db-053542a41337 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1739 microversion: 2.20 time: 0.237820 Jun 27 15:32:56.030089 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 406/811] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:55 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1739 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:56.460081 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9e1fa615-3d55-4f54-a7ac-01681f06d917 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:56.461798 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9e1fa615-3d55-4f54-a7ac-01681f06d917 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:56.473427 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e1fa615-3d55-4f54-a7ac-01681f06d917 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:56.477153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e1fa615-3d55-4f54-a7ac-01681f06d917 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:56.478349 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e1fa615-3d55-4f54-a7ac-01681f06d917 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:56.479012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e1fa615-3d55-4f54-a7ac-01681f06d917 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:56.519732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9e1fa615-3d55-4f54-a7ac-01681f06d917 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064682 Jun 27 15:32:56.520947 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 406/812] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:32:56 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:56.540985 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c941f6d5-d3ed-43b1-9295-e593d8c36286 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:56.544482 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-c941f6d5-d3ed-43b1-9295-e593d8c36286 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:56.558014 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c941f6d5-d3ed-43b1-9295-e593d8c36286 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:56.558539 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c941f6d5-d3ed-43b1-9295-e593d8c36286 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:56.559747 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c941f6d5-d3ed-43b1-9295-e593d8c36286 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:56.560699 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c941f6d5-d3ed-43b1-9295-e593d8c36286 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:56.613682 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c941f6d5-d3ed-43b1-9295-e593d8c36286 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments/d508b240-8049-4d68-8cfc-b03332f8ff4c" status: 200 len: 194 microversion: 2.1 time: 0.082144 Jun 27 15:32:56.615129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 407/813] 10.222.0.26 () {58 vars in 1412 bytes} [Mon Jun 27 15:32:56 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments/d508b240-8049-4d68-8cfc-b03332f8ff4c => generated 194 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:57.077140 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7dc9834d-43ab-43e3-a349-df6b5d21efb2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:57.081385 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7dc9834d-43ab-43e3-a349-df6b5d21efb2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:57.091502 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7dc9834d-43ab-43e3-a349-df6b5d21efb2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:57.092510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7dc9834d-43ab-43e3-a349-df6b5d21efb2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:57.093602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7dc9834d-43ab-43e3-a349-df6b5d21efb2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:57.094301 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7dc9834d-43ab-43e3-a349-df6b5d21efb2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:57.277272 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7dc9834d-43ab-43e3-a349-df6b5d21efb2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:57.287768 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7dc9834d-43ab-43e3-a349-df6b5d21efb2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:57.290870 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7dc9834d-43ab-43e3-a349-df6b5d21efb2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:57.293641 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7dc9834d-43ab-43e3-a349-df6b5d21efb2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1739 microversion: 2.20 time: 0.241034 Jun 27 15:32:57.294580 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 407/814] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:57 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1739 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:32:58.121497 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4884f02a-1b87-4952-a146-ab5fff1b0265 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad745891-7f2c-4ebc-a372-d24126d806e9"}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:32:58.124079 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4884f02a-1b87-4952-a146-ab5fff1b0265 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:58.132346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4884f02a-1b87-4952-a146-ab5fff1b0265 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:58.133102 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4884f02a-1b87-4952-a146-ab5fff1b0265 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:58.136773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4884f02a-1b87-4952-a146-ab5fff1b0265 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:58.137478 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4884f02a-1b87-4952-a146-ab5fff1b0265 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:58.318345 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-69b8feb3-bf9d-475a-9513-709822fe563a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:58.328623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-69b8feb3-bf9d-475a-9513-709822fe563a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:58.344882 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-69b8feb3-bf9d-475a-9513-709822fe563a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:58.346082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-69b8feb3-bf9d-475a-9513-709822fe563a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:58.349147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-69b8feb3-bf9d-475a-9513-709822fe563a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:58.350235 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-69b8feb3-bf9d-475a-9513-709822fe563a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:58.540080 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4884f02a-1b87-4952-a146-ab5fff1b0265 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "POST /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.423970 Jun 27 15:32:58.546050 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 408/815] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:32:58 2022] POST /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments => generated 194 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:32:58.627244 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-69b8feb3-bf9d-475a-9513-709822fe563a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:58.637055 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-69b8feb3-bf9d-475a-9513-709822fe563a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:58.639186 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-69b8feb3-bf9d-475a-9513-709822fe563a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:58.640478 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-69b8feb3-bf9d-475a-9513-709822fe563a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1739 microversion: 2.20 time: 0.330024 Jun 27 15:32:58.641163 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 408/816] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:58 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1739 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:32:59.670015 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fd4f0590-8f4c-4ee5-b860-7a04462f4329 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:32:59.671400 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-fd4f0590-8f4c-4ee5-b860-7a04462f4329 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:32:59.679203 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fd4f0590-8f4c-4ee5-b860-7a04462f4329 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:59.679890 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fd4f0590-8f4c-4ee5-b860-7a04462f4329 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:59.680907 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fd4f0590-8f4c-4ee5-b860-7a04462f4329 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:32:59.681507 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fd4f0590-8f4c-4ee5-b860-7a04462f4329 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:32:59.834105 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fd4f0590-8f4c-4ee5-b860-7a04462f4329 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:59.843893 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fd4f0590-8f4c-4ee5-b860-7a04462f4329 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:59.845586 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fd4f0590-8f4c-4ee5-b860-7a04462f4329 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:32:59.847150 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fd4f0590-8f4c-4ee5-b860-7a04462f4329 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1721 microversion: 2.20 time: 0.181551 Jun 27 15:32:59.847706 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 409/817] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:32:59 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1721 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:00.858593 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d049609f-f0a5-4c4b-8f43-8aa2b269a6aa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:00.859260 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d049609f-f0a5-4c4b-8f43-8aa2b269a6aa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:00.866533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d049609f-f0a5-4c4b-8f43-8aa2b269a6aa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:00.866992 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d049609f-f0a5-4c4b-8f43-8aa2b269a6aa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:00.867754 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d049609f-f0a5-4c4b-8f43-8aa2b269a6aa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:00.868199 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d049609f-f0a5-4c4b-8f43-8aa2b269a6aa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:00.870786 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5b40a462-fd8c-4e1a-abde-5a620292f32d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:00.871160 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5b40a462-fd8c-4e1a-abde-5a620292f32d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:00.884707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b40a462-fd8c-4e1a-abde-5a620292f32d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:00.885261 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b40a462-fd8c-4e1a-abde-5a620292f32d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:00.886133 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b40a462-fd8c-4e1a-abde-5a620292f32d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:00.887178 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5b40a462-fd8c-4e1a-abde-5a620292f32d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:00.894961 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d049609f-f0a5-4c4b-8f43-8aa2b269a6aa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/ips" status: 200 len: 149 microversion: 2.1 time: 0.041330 Jun 27 15:33:00.895660 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 409/818] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jun 27 15:33:00 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:01.052468 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b40a462-fd8c-4e1a-abde-5a620292f32d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:01.062961 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b40a462-fd8c-4e1a-abde-5a620292f32d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:01.065593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5b40a462-fd8c-4e1a-abde-5a620292f32d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:01.067269 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5b40a462-fd8c-4e1a-abde-5a620292f32d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1721 microversion: 2.20 time: 0.203152 Jun 27 15:33:01.068108 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 410/819] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:00 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1721 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:02.087963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-cdcce511-daa0-49aa-b544-d210ea243f81 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:02.088815 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-cdcce511-daa0-49aa-b544-d210ea243f81 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:02.098278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdcce511-daa0-49aa-b544-d210ea243f81 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:02.099044 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdcce511-daa0-49aa-b544-d210ea243f81 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:02.100524 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdcce511-daa0-49aa-b544-d210ea243f81 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:02.101176 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-cdcce511-daa0-49aa-b544-d210ea243f81 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:02.264769 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cdcce511-daa0-49aa-b544-d210ea243f81 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:02.275884 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cdcce511-daa0-49aa-b544-d210ea243f81 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:02.277453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-cdcce511-daa0-49aa-b544-d210ea243f81 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:02.278681 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-cdcce511-daa0-49aa-b544-d210ea243f81 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1664 microversion: 2.20 time: 0.196850 Jun 27 15:33:02.279242 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 410/820] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:02 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1664 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:02.300454 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8704e8b4-5195-4bfa-8048-90d2e1915a1a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "35e3a0e6-9f54-4340-bcb8-5bdba9e6f9c8"}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:02.301509 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8704e8b4-5195-4bfa-8048-90d2e1915a1a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:02.309434 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8704e8b4-5195-4bfa-8048-90d2e1915a1a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:02.310193 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8704e8b4-5195-4bfa-8048-90d2e1915a1a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:02.311328 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8704e8b4-5195-4bfa-8048-90d2e1915a1a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:02.312190 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8704e8b4-5195-4bfa-8048-90d2e1915a1a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:02.318099 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dd897993-ddbd-4bbc-a0be-883c165e1d68 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10fb9116-a90f-4949-b84e-61c0bfeae925"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:02.319196 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dd897993-ddbd-4bbc-a0be-883c165e1d68 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:02.325703 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd897993-ddbd-4bbc-a0be-883c165e1d68 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:02.326420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd897993-ddbd-4bbc-a0be-883c165e1d68 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:02.327202 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd897993-ddbd-4bbc-a0be-883c165e1d68 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:02.327789 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd897993-ddbd-4bbc-a0be-883c165e1d68 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:02.344865 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:02.721055 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dd897993-ddbd-4bbc-a0be-883c165e1d68 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.406182 Jun 27 15:33:02.732630 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 411/821] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:33:02 2022] POST /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments => generated 194 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:02.844793 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8704e8b4-5195-4bfa-8048-90d2e1915a1a tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "POST /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.548376 Jun 27 15:33:02.846883 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 411/822] 10.222.0.26 () {62 vars in 1363 bytes} [Mon Jun 27 15:33:02 2022] POST /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/os-volume_attachments => generated 188 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 15:33:03.055019 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d5e544d0-22bf-4582-b0cf-a5a24066c1b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:03.055619 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d5e544d0-22bf-4582-b0cf-a5a24066c1b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:03.062920 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d5e544d0-22bf-4582-b0cf-a5a24066c1b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:03.063373 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d5e544d0-22bf-4582-b0cf-a5a24066c1b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:03.064478 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d5e544d0-22bf-4582-b0cf-a5a24066c1b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:03.064925 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d5e544d0-22bf-4582-b0cf-a5a24066c1b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:03.379897 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d5e544d0-22bf-4582-b0cf-a5a24066c1b9 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "DELETE /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/os-volume_attachments/35e3a0e6-9f54-4340-bcb8-5bdba9e6f9c8" status: 202 len: 0 microversion: 2.20 time: 0.330523 Jun 27 15:33:03.380876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 412/823] 10.222.0.26 () {60 vars in 1456 bytes} [Mon Jun 27 15:33:03 2022] DELETE /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/os-volume_attachments/35e3a0e6-9f54-4340-bcb8-5bdba9e6f9c8 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:33:03.452536 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-473f8fe6-ee8f-41b7-ac11-f7a2f6a8ebc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:03.453497 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-473f8fe6-ee8f-41b7-ac11-f7a2f6a8ebc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:03.463045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-473f8fe6-ee8f-41b7-ac11-f7a2f6a8ebc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:03.464070 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-473f8fe6-ee8f-41b7-ac11-f7a2f6a8ebc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:03.464945 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-473f8fe6-ee8f-41b7-ac11-f7a2f6a8ebc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:03.465504 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-473f8fe6-ee8f-41b7-ac11-f7a2f6a8ebc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:03.559158 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=7,nova_cell1:INSERT=4 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:03.583287 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-473f8fe6-ee8f-41b7-ac11-f7a2f6a8ebc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "POST /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/action" status: 202 len: 0 microversion: 2.20 time: 0.135418 Jun 27 15:33:03.585129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 412/824] 10.222.0.26 () {62 vars in 1318 bytes} [Mon Jun 27 15:33:03 2022] POST /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:33:03.598499 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-754aad95-fc97-4ef7-aedb-077776d12cf4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:03.599112 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-754aad95-fc97-4ef7-aedb-077776d12cf4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:03.606786 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-754aad95-fc97-4ef7-aedb-077776d12cf4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:03.607236 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-754aad95-fc97-4ef7-aedb-077776d12cf4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:03.608242 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-754aad95-fc97-4ef7-aedb-077776d12cf4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:03.608899 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-754aad95-fc97-4ef7-aedb-077776d12cf4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:03.790966 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-754aad95-fc97-4ef7-aedb-077776d12cf4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:03.807168 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-754aad95-fc97-4ef7-aedb-077776d12cf4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:03.812603 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-754aad95-fc97-4ef7-aedb-077776d12cf4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:03.815694 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-754aad95-fc97-4ef7-aedb-077776d12cf4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1672 microversion: 2.20 time: 0.222737 Jun 27 15:33:03.817050 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 413/825] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:03 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1672 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:04.842878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2faf2015-2788-471e-b0d8-6c709c693189 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:04.845126 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2faf2015-2788-471e-b0d8-6c709c693189 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:04.857211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2faf2015-2788-471e-b0d8-6c709c693189 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:04.858518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2faf2015-2788-471e-b0d8-6c709c693189 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:04.861346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2faf2015-2788-471e-b0d8-6c709c693189 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:04.862798 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2faf2015-2788-471e-b0d8-6c709c693189 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:05.082040 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-9864cd39-a0f7-4d82-b0b7-303393214183 req-025c7ebd-2ffa-4f81-a19c-1e429479822e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886a9b39-9d64-4359-8d03-b07dbe1abf9c", "name": "network-vif-unplugged", "status": "completed", "tag": "82ee23e2-cf54-4c80-aa3a-825aa5c81193"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:05.101935 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-9864cd39-a0f7-4d82-b0b7-303393214183 req-025c7ebd-2ffa-4f81-a19c-1e429479822e service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:05.102776 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-9864cd39-a0f7-4d82-b0b7-303393214183 req-025c7ebd-2ffa-4f81-a19c-1e429479822e service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:05.129241 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2faf2015-2788-471e-b0d8-6c709c693189 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:05.131170 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.compute.server_external_events [req-9864cd39-a0f7-4d82-b0b7-303393214183 req-025c7ebd-2ffa-4f81-a19c-1e429479822e service nova] Unable to find a host for instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c. Dropping event network-vif-unplugged {{(pid=117978) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 15:33:05.134561 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-9864cd39-a0f7-4d82-b0b7-303393214183 req-025c7ebd-2ffa-4f81-a19c-1e429479822e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055408 Jun 27 15:33:05.141164 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 414/826] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:33:05 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 64 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jun 27 15:33:05.142073 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2faf2015-2788-471e-b0d8-6c709c693189 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:05.144577 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2faf2015-2788-471e-b0d8-6c709c693189 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:05.146519 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2faf2015-2788-471e-b0d8-6c709c693189 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1672 microversion: 2.20 time: 0.314019 Jun 27 15:33:05.147549 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 413/827] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:04 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1672 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:06.173169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6715ad36-5baa-4cb1-8407-f3b0ed0a4a54 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:06.178503 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6715ad36-5baa-4cb1-8407-f3b0ed0a4a54 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:06.193235 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6715ad36-5baa-4cb1-8407-f3b0ed0a4a54 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:06.202154 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6715ad36-5baa-4cb1-8407-f3b0ed0a4a54 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:06.205358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6715ad36-5baa-4cb1-8407-f3b0ed0a4a54 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:06.205358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6715ad36-5baa-4cb1-8407-f3b0ed0a4a54 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:06.244735 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2ddd5b7d-7f23-473b-a56e-52ffe7b75ce5 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:06.248158 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2ddd5b7d-7f23-473b-a56e-52ffe7b75ce5 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:06.264016 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2ddd5b7d-7f23-473b-a56e-52ffe7b75ce5 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:06.264744 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2ddd5b7d-7f23-473b-a56e-52ffe7b75ce5 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:06.281813 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2ddd5b7d-7f23-473b-a56e-52ffe7b75ce5 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:06.283673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2ddd5b7d-7f23-473b-a56e-52ffe7b75ce5 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:06.336740 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2ddd5b7d-7f23-473b-a56e-52ffe7b75ce5 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.103388 Jun 27 15:33:06.337581 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 414/828] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:33:06 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments => generated 371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:06.478026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b8929e1e-b18b-4d2d-a2aa-c525c8c82dba tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:06.478525 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b8929e1e-b18b-4d2d-a2aa-c525c8c82dba tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:06.485853 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8929e1e-b18b-4d2d-a2aa-c525c8c82dba tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:06.486595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8929e1e-b18b-4d2d-a2aa-c525c8c82dba tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:06.487391 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8929e1e-b18b-4d2d-a2aa-c525c8c82dba tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:06.487817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8929e1e-b18b-4d2d-a2aa-c525c8c82dba tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:06.522432 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b8929e1e-b18b-4d2d-a2aa-c525c8c82dba tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments/d508b240-8049-4d68-8cfc-b03332f8ff4c" status: 200 len: 194 microversion: 2.1 time: 0.048335 Jun 27 15:33:06.523036 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 415/829] 10.222.0.26 () {58 vars in 1412 bytes} [Mon Jun 27 15:33:06 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments/d508b240-8049-4d68-8cfc-b03332f8ff4c => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:33:06.532998 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-266bf7be-666e-4d11-98de-487873f7f459 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:06.533652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-266bf7be-666e-4d11-98de-487873f7f459 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:06.540240 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-266bf7be-666e-4d11-98de-487873f7f459 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:06.540664 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-266bf7be-666e-4d11-98de-487873f7f459 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:06.541445 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-266bf7be-666e-4d11-98de-487873f7f459 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:06.541881 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-266bf7be-666e-4d11-98de-487873f7f459 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:06.619715 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6715ad36-5baa-4cb1-8407-f3b0ed0a4a54 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:06.646612 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6715ad36-5baa-4cb1-8407-f3b0ed0a4a54 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:06.649054 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-266bf7be-666e-4d11-98de-487873f7f459 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lazy-loading 'services' on Instance uuid 902ddcef-106e-4a57-a046-8ea9f13aa8a1 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:33:06.649465 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6715ad36-5baa-4cb1-8407-f3b0ed0a4a54 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:06.651649 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6715ad36-5baa-4cb1-8407-f3b0ed0a4a54 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.488196 Jun 27 15:33:06.653444 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 415/830] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:06 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:06.778454 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-266bf7be-666e-4d11-98de-487873f7f459 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments/d508b240-8049-4d68-8cfc-b03332f8ff4c" status: 202 len: 0 microversion: 2.1 time: 0.249130 Jun 27 15:33:06.779287 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 416/831] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:33:06 2022] DELETE /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments/d508b240-8049-4d68-8cfc-b03332f8ff4c => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:33:07.673958 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6408cdc8-961d-4eb1-b390-a1f460949740 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:07.674865 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6408cdc8-961d-4eb1-b390-a1f460949740 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:07.682926 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6408cdc8-961d-4eb1-b390-a1f460949740 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:07.683398 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6408cdc8-961d-4eb1-b390-a1f460949740 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:07.685167 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6408cdc8-961d-4eb1-b390-a1f460949740 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:07.686057 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6408cdc8-961d-4eb1-b390-a1f460949740 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:08.545939 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6408cdc8-961d-4eb1-b390-a1f460949740 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:08.555986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6408cdc8-961d-4eb1-b390-a1f460949740 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:08.559309 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-6408cdc8-961d-4eb1-b390-a1f460949740 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:08.561377 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6408cdc8-961d-4eb1-b390-a1f460949740 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.891155 Jun 27 15:33:08.562854 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 416/832] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:07 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 893 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:09.580920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-06cbcbbb-0b8b-4d2b-bfd3-e4876891b4b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:09.582444 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-06cbcbbb-0b8b-4d2b-bfd3-e4876891b4b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:09.597938 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-06cbcbbb-0b8b-4d2b-bfd3-e4876891b4b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:09.601552 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-06cbcbbb-0b8b-4d2b-bfd3-e4876891b4b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:09.602854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-06cbcbbb-0b8b-4d2b-bfd3-e4876891b4b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:09.607854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-06cbcbbb-0b8b-4d2b-bfd3-e4876891b4b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:10.514811 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-06cbcbbb-0b8b-4d2b-bfd3-e4876891b4b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:10.525785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-06cbcbbb-0b8b-4d2b-bfd3-e4876891b4b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:10.531967 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-06cbcbbb-0b8b-4d2b-bfd3-e4876891b4b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:10.540971 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-06cbcbbb-0b8b-4d2b-bfd3-e4876891b4b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.960424 Jun 27 15:33:10.552608 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 417/833] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:09 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:11.573440 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e250d8c9-f05e-41f9-ad9e-0fbace52ae22 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:11.575135 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e250d8c9-f05e-41f9-ad9e-0fbace52ae22 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:11.622543 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=38 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:11.633156 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e250d8c9-f05e-41f9-ad9e-0fbace52ae22 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:11.633940 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e250d8c9-f05e-41f9-ad9e-0fbace52ae22 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:11.635429 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e250d8c9-f05e-41f9-ad9e-0fbace52ae22 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:11.639067 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e250d8c9-f05e-41f9-ad9e-0fbace52ae22 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:12.050674 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e250d8c9-f05e-41f9-ad9e-0fbace52ae22 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:12.060908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e250d8c9-f05e-41f9-ad9e-0fbace52ae22 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:12.063368 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e250d8c9-f05e-41f9-ad9e-0fbace52ae22 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:12.065032 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e250d8c9-f05e-41f9-ad9e-0fbace52ae22 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.507951 Jun 27 15:33:12.066150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 417/834] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:11 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:13.087378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-96908d1a-9ef7-4078-a728-f0f124d7c0b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:13.088151 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-96908d1a-9ef7-4078-a728-f0f124d7c0b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:13.109903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-96908d1a-9ef7-4078-a728-f0f124d7c0b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:13.110716 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-96908d1a-9ef7-4078-a728-f0f124d7c0b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:13.113664 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-96908d1a-9ef7-4078-a728-f0f124d7c0b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:13.116125 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-96908d1a-9ef7-4078-a728-f0f124d7c0b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:13.596568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-96908d1a-9ef7-4078-a728-f0f124d7c0b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:13.638237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-96908d1a-9ef7-4078-a728-f0f124d7c0b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:13.659970 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-96908d1a-9ef7-4078-a728-f0f124d7c0b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:13.663179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-96908d1a-9ef7-4078-a728-f0f124d7c0b7 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.581253 Jun 27 15:33:13.665230 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 418/835] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:13 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:14.688296 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e805d506-5ece-4037-a2b0-14b9987415bb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:14.689306 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e805d506-5ece-4037-a2b0-14b9987415bb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:14.709030 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e805d506-5ece-4037-a2b0-14b9987415bb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:14.709597 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e805d506-5ece-4037-a2b0-14b9987415bb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:14.710481 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e805d506-5ece-4037-a2b0-14b9987415bb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:14.710996 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e805d506-5ece-4037-a2b0-14b9987415bb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:15.236124 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e805d506-5ece-4037-a2b0-14b9987415bb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:15.263972 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e805d506-5ece-4037-a2b0-14b9987415bb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:15.272554 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e805d506-5ece-4037-a2b0-14b9987415bb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:15.276537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e805d506-5ece-4037-a2b0-14b9987415bb tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.590981 Jun 27 15:33:15.282797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 418/836] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:14 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:16.302456 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-49f374f1-ff41-4517-89c6-d94a19502c76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:16.305794 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-49f374f1-ff41-4517-89c6-d94a19502c76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:16.323720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-49f374f1-ff41-4517-89c6-d94a19502c76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:16.330665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-49f374f1-ff41-4517-89c6-d94a19502c76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:16.331919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-49f374f1-ff41-4517-89c6-d94a19502c76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:16.332559 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-49f374f1-ff41-4517-89c6-d94a19502c76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:17.003881 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2654679b-b66c-4aa1-b8ec-57445701d2e5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "10fb9116-a90f-4949-b84e-61c0bfeae925"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:17.009697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2654679b-b66c-4aa1-b8ec-57445701d2e5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:17.039640 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2654679b-b66c-4aa1-b8ec-57445701d2e5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:17.040244 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2654679b-b66c-4aa1-b8ec-57445701d2e5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:17.041144 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2654679b-b66c-4aa1-b8ec-57445701d2e5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:17.042260 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2654679b-b66c-4aa1-b8ec-57445701d2e5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:17.262379 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-2654679b-b66c-4aa1-b8ec-57445701d2e5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Invalid volume: volume 10fb9116-a90f-4949-b84e-61c0bfeae925 is already attached to instances: a3afef28-40eb-48c6-a65c-f549cc963cda Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2654679b-b66c-4aa1-b8ec-57445701d2e5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: POST /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments HTTP/1.1 Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 74 Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:33:17.286984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {"volumeAttachment": {"volumeId": "10fb9116-a90f-4949-b84e-61c0bfeae925"}} Jun 27 15:33:17.288746 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Invalid volume: volume 10fb9116-a90f-4949-b84e-61c0bfeae925 is already attached to instances: a3afef28-40eb-48c6-a65c-f549cc963cda Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'server_id': 'a3afef28-40eb-48c6-a65c-f549cc963cda', 'body': {'volumeAttachment': {'volumeId': '10fb9116-a90f-4949-b84e-61c0bfeae925'}}} Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 10fb9116-a90f-4949-b84e-61c0bfeae925 is already attached to instances: a3afef28-40eb-48c6-a65c-f549cc963cda Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:17.289497 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 10fb9116-a90f-4949-b84e-61c0bfeae925 is already attached to instances: a3afef28-40eb-48c6-a65c-f549cc963cda Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:17.290834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:17.292189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:17.292189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:33:17.292189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:33:17.292189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 10fb9116-a90f-4949-b84e-61c0bfeae925 is already attached to instances: a3afef28-40eb-48c6-a65c-f549cc963cda Jun 27 15:33:17.292189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:17.294674 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2654679b-b66c-4aa1-b8ec-57445701d2e5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 400 to user: Invalid volume: volume 10fb9116-a90f-4949-b84e-61c0bfeae925 is already attached to instances: a3afef28-40eb-48c6-a65c-f549cc963cda {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:33:17.296394 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2654679b-b66c-4aa1-b8ec-57445701d2e5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.298224 Jun 27 15:33:17.303058 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 419/837] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:33:16 2022] POST /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments => generated 174 bytes in 306 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 15:33:17.532569 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5d9315bd-d6c4-4747-a1a8-77dd0dda7e7c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:17.538111 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5d9315bd-d6c4-4747-a1a8-77dd0dda7e7c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:17.577549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d9315bd-d6c4-4747-a1a8-77dd0dda7e7c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:17.589025 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d9315bd-d6c4-4747-a1a8-77dd0dda7e7c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:17.592811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d9315bd-d6c4-4747-a1a8-77dd0dda7e7c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:17.601695 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5d9315bd-d6c4-4747-a1a8-77dd0dda7e7c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:17.632807 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-49f374f1-ff41-4517-89c6-d94a19502c76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:17.704010 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-49f374f1-ff41-4517-89c6-d94a19502c76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:17.735047 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-49f374f1-ff41-4517-89c6-d94a19502c76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:17.763437 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-49f374f1-ff41-4517-89c6-d94a19502c76 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 1.464485 Jun 27 15:33:17.791804 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 419/838] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:16 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 1494 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:17.974461 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-5d9315bd-d6c4-4747-a1a8-77dd0dda7e7c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lazy-loading 'services' on Instance uuid a3afef28-40eb-48c6-a65c-f549cc963cda {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:33:18.194415 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5d9315bd-d6c4-4747-a1a8-77dd0dda7e7c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments/10fb9116-a90f-4949-b84e-61c0bfeae925" status: 202 len: 0 microversion: 2.1 time: 0.668336 Jun 27 15:33:18.196335 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 420/839] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:33:17 2022] DELETE /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments/10fb9116-a90f-4949-b84e-61c0bfeae925 => generated 0 bytes in 673 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:33:18.206642 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4603f346-5cb5-4096-b109-a79a106e8dba tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:18.207987 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4603f346-5cb5-4096-b109-a79a106e8dba tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:18.223608 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4603f346-5cb5-4096-b109-a79a106e8dba tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:18.225739 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4603f346-5cb5-4096-b109-a79a106e8dba tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:18.227133 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4603f346-5cb5-4096-b109-a79a106e8dba tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:18.230048 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4603f346-5cb5-4096-b109-a79a106e8dba tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:18.267978 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4af1fcd3-603b-4ddd-8555-cdde0c0b33f8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:18.268913 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4af1fcd3-603b-4ddd-8555-cdde0c0b33f8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:18.284012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4af1fcd3-603b-4ddd-8555-cdde0c0b33f8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:18.284920 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4af1fcd3-603b-4ddd-8555-cdde0c0b33f8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:18.289720 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4af1fcd3-603b-4ddd-8555-cdde0c0b33f8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:18.291989 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4af1fcd3-603b-4ddd-8555-cdde0c0b33f8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:18.348833 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4603f346-5cb5-4096-b109-a79a106e8dba tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.147356 Jun 27 15:33:18.351696 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 420/840] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:33:18 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments => generated 197 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:18.402620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4af1fcd3-603b-4ddd-8555-cdde0c0b33f8 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments/ad745891-7f2c-4ebc-a372-d24126d806e9" status: 200 len: 194 microversion: 2.1 time: 0.139434 Jun 27 15:33:18.404525 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 421/841] 10.222.0.26 () {58 vars in 1412 bytes} [Mon Jun 27 15:33:18 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments/ad745891-7f2c-4ebc-a372-d24126d806e9 => generated 194 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:18.417565 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-abf4cb57-e278-462e-b83a-a3e8110a1ed7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:18.418683 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-abf4cb57-e278-462e-b83a-a3e8110a1ed7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:18.439554 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abf4cb57-e278-462e-b83a-a3e8110a1ed7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:18.440034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abf4cb57-e278-462e-b83a-a3e8110a1ed7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:18.440966 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abf4cb57-e278-462e-b83a-a3e8110a1ed7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:18.441718 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abf4cb57-e278-462e-b83a-a3e8110a1ed7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:18.590267 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-abf4cb57-e278-462e-b83a-a3e8110a1ed7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lazy-loading 'services' on Instance uuid 902ddcef-106e-4a57-a046-8ea9f13aa8a1 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:33:18.741931 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-abf4cb57-e278-462e-b83a-a3e8110a1ed7 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments/ad745891-7f2c-4ebc-a372-d24126d806e9" status: 202 len: 0 microversion: 2.1 time: 0.329269 Jun 27 15:33:18.742672 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 421/842] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:33:18 2022] DELETE /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments/ad745891-7f2c-4ebc-a372-d24126d806e9 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:33:18.796989 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3fa8d5a2-c360-422c-9458-33379da2d9c5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:18.797645 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3fa8d5a2-c360-422c-9458-33379da2d9c5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:18.811772 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fa8d5a2-c360-422c-9458-33379da2d9c5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:18.812703 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fa8d5a2-c360-422c-9458-33379da2d9c5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:18.813894 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fa8d5a2-c360-422c-9458-33379da2d9c5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:18.815085 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3fa8d5a2-c360-422c-9458-33379da2d9c5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:19.242413 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3fa8d5a2-c360-422c-9458-33379da2d9c5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:19.254505 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3fa8d5a2-c360-422c-9458-33379da2d9c5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:19.256594 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3fa8d5a2-c360-422c-9458-33379da2d9c5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:19.258073 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3fa8d5a2-c360-422c-9458-33379da2d9c5 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.466878 Jun 27 15:33:19.258850 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 422/843] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:18 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:19.363870 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-43b187f3-d0c0-4554-9a72-3dcfbd403cbf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:19.365256 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-43b187f3-d0c0-4554-9a72-3dcfbd403cbf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:19.373152 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-43b187f3-d0c0-4554-9a72-3dcfbd403cbf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:19.373751 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-43b187f3-d0c0-4554-9a72-3dcfbd403cbf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:19.374665 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-43b187f3-d0c0-4554-9a72-3dcfbd403cbf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:19.375353 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-43b187f3-d0c0-4554-9a72-3dcfbd403cbf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:19.412288 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-43b187f3-d0c0-4554-9a72-3dcfbd403cbf tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054235 Jun 27 15:33:19.416596 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 422/844] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:33:19 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:20.281784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5a3ef78d-4118-4f25-8d7f-d057dc99734e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:20.282392 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5a3ef78d-4118-4f25-8d7f-d057dc99734e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:20.290169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5a3ef78d-4118-4f25-8d7f-d057dc99734e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:20.290611 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5a3ef78d-4118-4f25-8d7f-d057dc99734e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:20.291871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5a3ef78d-4118-4f25-8d7f-d057dc99734e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:20.292303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5a3ef78d-4118-4f25-8d7f-d057dc99734e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:20.432204 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8113ecec-c04f-4459-957c-68d85fdf5485 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:20.438890 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8113ecec-c04f-4459-957c-68d85fdf5485 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:20.460388 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8113ecec-c04f-4459-957c-68d85fdf5485 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:20.460940 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8113ecec-c04f-4459-957c-68d85fdf5485 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:20.461691 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8113ecec-c04f-4459-957c-68d85fdf5485 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:20.462135 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8113ecec-c04f-4459-957c-68d85fdf5485 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:20.506642 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8113ecec-c04f-4459-957c-68d85fdf5485 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085246 Jun 27 15:33:20.508787 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 423/845] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:33:20 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:20.610992 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5a3ef78d-4118-4f25-8d7f-d057dc99734e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:20.633107 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5a3ef78d-4118-4f25-8d7f-d057dc99734e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:20.635284 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5a3ef78d-4118-4f25-8d7f-d057dc99734e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:20.637821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5a3ef78d-4118-4f25-8d7f-d057dc99734e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.359810 Jun 27 15:33:20.638657 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 423/846] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:20 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 15:33:21.239589 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-482cf4d6-3854-4ff3-ab56-90227eb24160 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:21.241507 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-482cf4d6-3854-4ff3-ab56-90227eb24160 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:21.255451 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-482cf4d6-3854-4ff3-ab56-90227eb24160 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.257324 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-482cf4d6-3854-4ff3-ab56-90227eb24160 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.258806 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-482cf4d6-3854-4ff3-ab56-90227eb24160 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.259633 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-482cf4d6-3854-4ff3-ab56-90227eb24160 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.311687 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-482cf4d6-3854-4ff3-ab56-90227eb24160 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.078934 Jun 27 15:33:21.312629 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 424/847] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:33:21 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments => generated 25 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:33:21.449785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9d31e84b-af5a-44fd-9823-1622f88faa09 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:21.451475 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9d31e84b-af5a-44fd-9823-1622f88faa09 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:21.458814 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d31e84b-af5a-44fd-9823-1622f88faa09 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.459362 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d31e84b-af5a-44fd-9823-1622f88faa09 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.460421 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d31e84b-af5a-44fd-9823-1622f88faa09 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.461081 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9d31e84b-af5a-44fd-9823-1622f88faa09 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.493730 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7c5dff6e-d620-452e-8477-796593b91a0d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Action: 'create', calling method: .version_select at 0x7fb2736e1280>, body: {"keypair": {"name": "tempest-TestShelveInstance-1394865336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI4f716+iK7i0qR8lfpdY5DwS3vhHDg/wDgo0L/QINjbMbRRpR4/t1TD9wGbIZbI0zlMSNQM9+UEpwUlQqQO3hgyVc3BIprL9MbfR/fZqcgoZh6idpP9M73ZFSfGDdAq8g=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:21.494737 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9d31e84b-af5a-44fd-9823-1622f88faa09 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048882 Jun 27 15:33:21.500161 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 425/848] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:33:21 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 15:33:21.519315 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-7c5dff6e-d620-452e-8477-796593b91a0d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Getting quotas for project 9954040eb98d4ecdafbc681132689ff5. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:33:21.522407 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-76141b4a-0496-459b-af01-109e93438b59 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:21.536847 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-76141b4a-0496-459b-af01-109e93438b59 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:21.537543 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-7c5dff6e-d620-452e-8477-796593b91a0d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Getting quotas for user b35218bf5d284771b5107601ec633f7c and project 9954040eb98d4ecdafbc681132689ff5. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:33:21.537730 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76141b4a-0496-459b-af01-109e93438b59 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.537730 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76141b4a-0496-459b-af01-109e93438b59 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.537730 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76141b4a-0496-459b-af01-109e93438b59 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.537730 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76141b4a-0496-459b-af01-109e93438b59 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.577870 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-76141b4a-0496-459b-af01-109e93438b59 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.061287 Jun 27 15:33:21.578934 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 426/849] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:33:21 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda/os-volume_attachments => generated 25 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:33:21.585014 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-76ecdc76-f0e3-4122-ae37-f7b5e74a8dca tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:21.585825 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-76ecdc76-f0e3-4122-ae37-f7b5e74a8dca tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:21.598372 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76ecdc76-f0e3-4122-ae37-f7b5e74a8dca tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.598812 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76ecdc76-f0e3-4122-ae37-f7b5e74a8dca tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.599600 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76ecdc76-f0e3-4122-ae37-f7b5e74a8dca tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.600031 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-76ecdc76-f0e3-4122-ae37-f7b5e74a8dca tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.612578 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7c5dff6e-d620-452e-8477-796593b91a0d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.368934 Jun 27 15:33:21.613994 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 424/850] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jun 27 15:33:21 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:21.660045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-76ecdc76-f0e3-4122-ae37-f7b5e74a8dca tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Going to try to terminate instance {{(pid=117977) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:33:21.669698 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ade43e7f-4c38-42c5-95af-675cd1acb2ec tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:21.671182 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ade43e7f-4c38-42c5-95af-675cd1acb2ec tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:21.692724 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=97 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:21.717764 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ade43e7f-4c38-42c5-95af-675cd1acb2ec tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.721162 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ade43e7f-4c38-42c5-95af-675cd1acb2ec tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.721162 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ade43e7f-4c38-42c5-95af-675cd1acb2ec tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.725061 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ade43e7f-4c38-42c5-95af-675cd1acb2ec tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.747267 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:21.889622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-76ecdc76-f0e3-4122-ae37-f7b5e74a8dca tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 204 len: 0 microversion: 2.1 time: 0.307818 Jun 27 15:33:21.891808 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 427/851] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:33:21 2022] DELETE /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:33:21.903100 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ab8d8462-a74d-4144-9758-356021d00307 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:21.904275 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ab8d8462-a74d-4144-9758-356021d00307 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:21.914385 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab8d8462-a74d-4144-9758-356021d00307 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.914839 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab8d8462-a74d-4144-9758-356021d00307 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.915686 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab8d8462-a74d-4144-9758-356021d00307 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:21.916409 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ab8d8462-a74d-4144-9758-356021d00307 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:21.950193 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ab8d8462-a74d-4144-9758-356021d00307 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Going to try to terminate instance {{(pid=117977) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:33:22.046818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ade43e7f-4c38-42c5-95af-675cd1acb2ec tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:22.056272 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ade43e7f-4c38-42c5-95af-675cd1acb2ec tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:22.058617 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ade43e7f-4c38-42c5-95af-675cd1acb2ec tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:22.060120 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ade43e7f-4c38-42c5-95af-675cd1acb2ec tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.399940 Jun 27 15:33:22.060374 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ab8d8462-a74d-4144-9758-356021d00307 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 204 len: 0 microversion: 2.1 time: 0.165926 Jun 27 15:33:22.060736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 425/852] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:21 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:22.064082 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 428/853] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:33:21 2022] DELETE /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:33:22.069536 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-67636430-0bcc-41c0-beec-b5b5928f8d0c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:22.070422 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-67636430-0bcc-41c0-beec-b5b5928f8d0c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:22.076058 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-23e17bb3-8540-40d7-926d-9d65bdfda88e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:22.076978 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-23e17bb3-8540-40d7-926d-9d65bdfda88e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:22.082517 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67636430-0bcc-41c0-beec-b5b5928f8d0c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:22.084822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67636430-0bcc-41c0-beec-b5b5928f8d0c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:22.086232 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67636430-0bcc-41c0-beec-b5b5928f8d0c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:22.086701 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-67636430-0bcc-41c0-beec-b5b5928f8d0c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:22.093946 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23e17bb3-8540-40d7-926d-9d65bdfda88e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:22.094398 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23e17bb3-8540-40d7-926d-9d65bdfda88e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:22.095221 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23e17bb3-8540-40d7-926d-9d65bdfda88e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:22.095684 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-23e17bb3-8540-40d7-926d-9d65bdfda88e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:22.286393 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-67636430-0bcc-41c0-beec-b5b5928f8d0c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:22.297531 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-67636430-0bcc-41c0-beec-b5b5928f8d0c tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1674 microversion: 2.1 time: 0.231803 Jun 27 15:33:22.298217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 426/854] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:22 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1674 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:22.308606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-23e17bb3-8540-40d7-926d-9d65bdfda88e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:22.319849 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-23e17bb3-8540-40d7-926d-9d65bdfda88e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1680 microversion: 2.1 time: 0.252953 Jun 27 15:33:22.320941 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 429/855] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:22 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1680 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:23.080920 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-63405ee4-a558-4fca-86a8-78b3ae8055d8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:23.082305 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-63405ee4-a558-4fca-86a8-78b3ae8055d8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:23.088956 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63405ee4-a558-4fca-86a8-78b3ae8055d8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:23.089415 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63405ee4-a558-4fca-86a8-78b3ae8055d8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:23.090190 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63405ee4-a558-4fca-86a8-78b3ae8055d8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:23.090858 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-63405ee4-a558-4fca-86a8-78b3ae8055d8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:23.259367 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-63405ee4-a558-4fca-86a8-78b3ae8055d8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:23.276609 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-63405ee4-a558-4fca-86a8-78b3ae8055d8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:23.279355 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-63405ee4-a558-4fca-86a8-78b3ae8055d8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:23.281626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-63405ee4-a558-4fca-86a8-78b3ae8055d8 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.205946 Jun 27 15:33:23.293039 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 427/856] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:23 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:23.320887 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3cee02dd-44fa-43be-b290-5903afd347fa tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:23.322481 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3cee02dd-44fa-43be-b290-5903afd347fa tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:23.330457 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:23.337929 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3cee02dd-44fa-43be-b290-5903afd347fa tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:23.339215 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-64c9d12c-4357-49e1-b520-6c348da7d569 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:23.339723 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-64c9d12c-4357-49e1-b520-6c348da7d569 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:23.340622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3cee02dd-44fa-43be-b290-5903afd347fa tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:23.341955 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3cee02dd-44fa-43be-b290-5903afd347fa tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:23.342644 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3cee02dd-44fa-43be-b290-5903afd347fa tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:23.348008 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64c9d12c-4357-49e1-b520-6c348da7d569 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:23.348511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64c9d12c-4357-49e1-b520-6c348da7d569 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:23.349301 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64c9d12c-4357-49e1-b520-6c348da7d569 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:23.349731 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-64c9d12c-4357-49e1-b520-6c348da7d569 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:23.582629 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3cee02dd-44fa-43be-b290-5903afd347fa tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:23.594310 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3cee02dd-44fa-43be-b290-5903afd347fa tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1674 microversion: 2.1 time: 0.279390 Jun 27 15:33:23.595767 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 430/857] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:23 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1674 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:33:23.619751 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-64c9d12c-4357-49e1-b520-6c348da7d569 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:23.628792 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-64c9d12c-4357-49e1-b520-6c348da7d569 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1680 microversion: 2.1 time: 0.293528 Jun 27 15:33:23.629363 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 428/858] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:23 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1680 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:33:24.301229 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-49eaeeea-83b7-44e5-88c1-c6d62ccda84b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:24.301856 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-49eaeeea-83b7-44e5-88c1-c6d62ccda84b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:24.309296 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-49eaeeea-83b7-44e5-88c1-c6d62ccda84b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:24.309852 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-49eaeeea-83b7-44e5-88c1-c6d62ccda84b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:24.310752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-49eaeeea-83b7-44e5-88c1-c6d62ccda84b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:24.311307 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-49eaeeea-83b7-44e5-88c1-c6d62ccda84b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:24.469737 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-49eaeeea-83b7-44e5-88c1-c6d62ccda84b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:24.478716 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-49eaeeea-83b7-44e5-88c1-c6d62ccda84b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:24.480880 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-49eaeeea-83b7-44e5-88c1-c6d62ccda84b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:24.482452 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-49eaeeea-83b7-44e5-88c1-c6d62ccda84b tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.186802 Jun 27 15:33:24.483248 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 431/859] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:24 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:24.614197 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-13fcf9f8-a61d-4973-b873-af81bb9cbb47 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:24.614767 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-13fcf9f8-a61d-4973-b873-af81bb9cbb47 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:24.621841 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13fcf9f8-a61d-4973-b873-af81bb9cbb47 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:24.622442 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13fcf9f8-a61d-4973-b873-af81bb9cbb47 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:24.623392 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13fcf9f8-a61d-4973-b873-af81bb9cbb47 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:24.623852 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-13fcf9f8-a61d-4973-b873-af81bb9cbb47 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:24.654892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-aa6ef06e-5c9f-429a-b681-cc1c9ab6a13a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:24.655306 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-aa6ef06e-5c9f-429a-b681-cc1c9ab6a13a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:24.678566 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aa6ef06e-5c9f-429a-b681-cc1c9ab6a13a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:24.679015 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aa6ef06e-5c9f-429a-b681-cc1c9ab6a13a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:24.681574 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aa6ef06e-5c9f-429a-b681-cc1c9ab6a13a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:24.682030 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aa6ef06e-5c9f-429a-b681-cc1c9ab6a13a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:24.808173 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-13fcf9f8-a61d-4973-b873-af81bb9cbb47 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:24.818667 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-13fcf9f8-a61d-4973-b873-af81bb9cbb47 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1674 microversion: 2.1 time: 0.209576 Jun 27 15:33:24.819278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 429/860] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:24 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1674 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:25.064814 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-aa6ef06e-5c9f-429a-b681-cc1c9ab6a13a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:25.085967 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-aa6ef06e-5c9f-429a-b681-cc1c9ab6a13a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1680 microversion: 2.1 time: 0.435168 Jun 27 15:33:25.086381 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 432/861] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:24 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1680 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:25.301193 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-bea80146-3edd-470e-a487-755487cbf6c1 req-2e690452-c0b8-4d14-a45e-dc0d5f2b4048 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886a9b39-9d64-4359-8d03-b07dbe1abf9c", "name": "network-vif-plugged", "status": "completed", "tag": "82ee23e2-cf54-4c80-aa3a-825aa5c81193"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:25.325950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-bea80146-3edd-470e-a487-755487cbf6c1 req-2e690452-c0b8-4d14-a45e-dc0d5f2b4048 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:25.335187 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-bea80146-3edd-470e-a487-755487cbf6c1 req-2e690452-c0b8-4d14-a45e-dc0d5f2b4048 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:25.351270 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-bea80146-3edd-470e-a487-755487cbf6c1 req-2e690452-c0b8-4d14-a45e-dc0d5f2b4048 service nova] Creating event network-vif-plugged:82ee23e2-cf54-4c80-aa3a-825aa5c81193 for instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c on hv-cinder-84779 Jun 27 15:33:25.370466 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-bea80146-3edd-470e-a487-755487cbf6c1 req-2e690452-c0b8-4d14-a45e-dc0d5f2b4048 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073893 Jun 27 15:33:25.374336 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 430/862] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:33:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:25.507342 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e4c42e89-0025-4d6f-810f-025367a34608 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:25.509379 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e4c42e89-0025-4d6f-810f-025367a34608 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:25.537516 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4c42e89-0025-4d6f-810f-025367a34608 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:25.541391 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4c42e89-0025-4d6f-810f-025367a34608 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:25.542641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4c42e89-0025-4d6f-810f-025367a34608 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:25.545230 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e4c42e89-0025-4d6f-810f-025367a34608 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:25.845988 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1104336c-d1a7-4c7c-a550-cc5fbc5166f2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:25.853273 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1104336c-d1a7-4c7c-a550-cc5fbc5166f2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:25.869900 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1104336c-d1a7-4c7c-a550-cc5fbc5166f2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:25.871000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1104336c-d1a7-4c7c-a550-cc5fbc5166f2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:25.872420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1104336c-d1a7-4c7c-a550-cc5fbc5166f2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:25.873819 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1104336c-d1a7-4c7c-a550-cc5fbc5166f2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:25.988662 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e4c42e89-0025-4d6f-810f-025367a34608 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:26.055575 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e4c42e89-0025-4d6f-810f-025367a34608 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:26.084697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1104336c-d1a7-4c7c-a550-cc5fbc5166f2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:26.089798 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e4c42e89-0025-4d6f-810f-025367a34608 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:26.097638 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e4c42e89-0025-4d6f-810f-025367a34608 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.589964 Jun 27 15:33:26.098633 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 433/863] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:25 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:26.099769 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1104336c-d1a7-4c7c-a550-cc5fbc5166f2 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1606 microversion: 2.1 time: 0.265823 Jun 27 15:33:26.101292 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 431/864] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:25 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1606 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:33:26.114064 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9f8783a6-ebde-46c9-b1c9-12e0c1019179 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:26.114687 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9f8783a6-ebde-46c9-b1c9-12e0c1019179 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:26.156720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9f8783a6-ebde-46c9-b1c9-12e0c1019179 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:26.157431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9f8783a6-ebde-46c9-b1c9-12e0c1019179 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:26.161100 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9f8783a6-ebde-46c9-b1c9-12e0c1019179 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:26.161798 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9f8783a6-ebde-46c9-b1c9-12e0c1019179 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:26.515873 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9f8783a6-ebde-46c9-b1c9-12e0c1019179 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:26.531313 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9f8783a6-ebde-46c9-b1c9-12e0c1019179 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1680 microversion: 2.1 time: 0.427079 Jun 27 15:33:26.531822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 434/865] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:26 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1680 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:26.906602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-3858e3d6-46be-4d13-9b3a-58efb64c6591 req-f5143fa5-3a6a-460b-9c2a-c1bc509788da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "902ddcef-106e-4a57-a046-8ea9f13aa8a1", "name": "network-vif-deleted", "tag": "08e3ae6c-5577-48e3-8481-9b2849653b64"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:26.920095 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-3858e3d6-46be-4d13-9b3a-58efb64c6591 req-f5143fa5-3a6a-460b-9c2a-c1bc509788da service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:26.920757 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-3858e3d6-46be-4d13-9b3a-58efb64c6591 req-f5143fa5-3a6a-460b-9c2a-c1bc509788da service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:26.936569 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-3858e3d6-46be-4d13-9b3a-58efb64c6591 req-f5143fa5-3a6a-460b-9c2a-c1bc509788da service nova] Creating event network-vif-deleted:08e3ae6c-5577-48e3-8481-9b2849653b64 for instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 on hv-cinder-84779 Jun 27 15:33:26.943358 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-3858e3d6-46be-4d13-9b3a-58efb64c6591 req-f5143fa5-3a6a-460b-9c2a-c1bc509788da service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040433 Jun 27 15:33:26.948872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 432/866] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:33:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:27.126864 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9484170e-81a1-4b7a-aaa2-ab4a409e5e4e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:27.127897 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9484170e-81a1-4b7a-aaa2-ab4a409e5e4e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:27.131680 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:27.133409 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:27.147435 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9484170e-81a1-4b7a-aaa2-ab4a409e5e4e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:27.147972 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9484170e-81a1-4b7a-aaa2-ab4a409e5e4e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:27.148728 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9484170e-81a1-4b7a-aaa2-ab4a409e5e4e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:27.149171 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9484170e-81a1-4b7a-aaa2-ab4a409e5e4e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:27.156210 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:27.157591 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:27.161812 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:27.165560 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:27.261741 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:27.262640 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:27.263322 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lazy-loading 'fault' on Instance uuid 902ddcef-106e-4a57-a046-8ea9f13aa8a1 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:33:27.343646 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '995fa1760f5241588a493e5f894b0e3f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2e07fc46cd5f4afe875767c926bd63ee', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:27.355757 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3f8b5918-d55c-4ec7-9034-2b24c38d5ecb tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 200 len: 1327 microversion: 2.1 time: 0.241795 Jun 27 15:33:27.359397 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 435/867] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:27 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 1327 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:27.378692 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-9fa0d3b5-e54b-448c-b5f6-1bb64ad54637 req-42c2ea87-c03c-4cf3-8f01-142396ea6acf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3afef28-40eb-48c6-a65c-f549cc963cda", "name": "network-vif-deleted", "tag": "15808846-1217-422f-a8ef-2e30bfe2ee06"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:27.400373 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-9fa0d3b5-e54b-448c-b5f6-1bb64ad54637 req-42c2ea87-c03c-4cf3-8f01-142396ea6acf service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:27.401314 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-9fa0d3b5-e54b-448c-b5f6-1bb64ad54637 req-42c2ea87-c03c-4cf3-8f01-142396ea6acf service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:27.438126 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-9fa0d3b5-e54b-448c-b5f6-1bb64ad54637 req-42c2ea87-c03c-4cf3-8f01-142396ea6acf service nova] Creating event network-vif-deleted:15808846-1217-422f-a8ef-2e30bfe2ee06 for instance a3afef28-40eb-48c6-a65c-f549cc963cda on hv-cinder-84779 Jun 27 15:33:27.452667 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-9fa0d3b5-e54b-448c-b5f6-1bb64ad54637 req-42c2ea87-c03c-4cf3-8f01-142396ea6acf service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078580 Jun 27 15:33:27.454411 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 436/868] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:33:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:27.524744 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9484170e-81a1-4b7a-aaa2-ab4a409e5e4e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:27.545397 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9484170e-81a1-4b7a-aaa2-ab4a409e5e4e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:27.551468 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5df03730-125e-4f5a-8b68-c56b45953ddb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:27.552091 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9484170e-81a1-4b7a-aaa2-ab4a409e5e4e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:27.553728 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5df03730-125e-4f5a-8b68-c56b45953ddb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:27.554989 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9484170e-81a1-4b7a-aaa2-ab4a409e5e4e tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.434168 Jun 27 15:33:27.558072 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 433/869] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:27 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:27.579176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5df03730-125e-4f5a-8b68-c56b45953ddb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:27.581707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5df03730-125e-4f5a-8b68-c56b45953ddb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:27.584466 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5df03730-125e-4f5a-8b68-c56b45953ddb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:27.588066 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5df03730-125e-4f5a-8b68-c56b45953ddb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:27.718972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5df03730-125e-4f5a-8b68-c56b45953ddb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:27.728410 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5df03730-125e-4f5a-8b68-c56b45953ddb tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 200 len: 1326 microversion: 2.1 time: 0.183106 Jun 27 15:33:27.730662 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 437/870] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:27 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 1326 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:28.387390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-167ffc7e-8105-484d-95ff-0c91e458ffd6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:28.388634 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-167ffc7e-8105-484d-95ff-0c91e458ffd6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:28.409206 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-167ffc7e-8105-484d-95ff-0c91e458ffd6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:28.409903 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-167ffc7e-8105-484d-95ff-0c91e458ffd6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:28.413156 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-167ffc7e-8105-484d-95ff-0c91e458ffd6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:28.414735 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-167ffc7e-8105-484d-95ff-0c91e458ffd6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:28.462664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-167ffc7e-8105-484d-95ff-0c91e458ffd6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] HTTP exception thrown: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-167ffc7e-8105-484d-95ff-0c91e458ffd6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Request method failure captured: Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 HTTP/1.1 Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwyhrXvpCqPplKR8a98QVW12ooHNqCqz3XSZt4F1-ZWvgXF3_E0pDZdI1mpf1FP68Pt2IiSEj3mwGTFfKKSP6UuEMPBgq0a_li_vWxHfgwscJr-_9K5L_jGwrNrkYlIwdKmlfh79C7JTu_grOi_I79QkBbJRd7RLlkSFE7PpXtB-ig Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:33:28.465960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e07fc46cd5f4afe875767c926bd63ee", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 995fa1760f5241588a493e5f894b0e3f Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:28.467595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '902ddcef-106e-4a57-a046-8ea9f13aa8a1'} Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:33:28.468507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:28.470078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:28.475465 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-167ffc7e-8105-484d-95ff-0c91e458ffd6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Returning 404 to user: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:33:28.477423 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-167ffc7e-8105-484d-95ff-0c91e458ffd6 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 404 len: 111 microversion: 2.1 time: 0.100058 Jun 27 15:33:28.483642 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 434/871] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:28 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:33:28.490495 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3330ee17-d5c3-41f0-9c31-377bb0b510fa tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '.version_select at 0x7fb27349da60>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:28.538897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3330ee17-d5c3-41f0-9c31-377bb0b510fa tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767533954" status: 202 len: 0 microversion: 2.1 time: 0.054729 Jun 27 15:33:28.539391 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 438/872] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jun 27 15:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1767533954 => generated 0 bytes in 56 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:33:28.583005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-54bda27a-f2c7-4f44-993c-05febe6903d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:28.584180 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-54bda27a-f2c7-4f44-993c-05febe6903d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:28.623657 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54bda27a-f2c7-4f44-993c-05febe6903d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:28.624112 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54bda27a-f2c7-4f44-993c-05febe6903d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:28.624933 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54bda27a-f2c7-4f44-993c-05febe6903d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:28.625361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-54bda27a-f2c7-4f44-993c-05febe6903d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:28.751354 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e560ced7-c226-4a0b-81fc-b14103367748 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:28.752595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e560ced7-c226-4a0b-81fc-b14103367748 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:28.760137 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e560ced7-c226-4a0b-81fc-b14103367748 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:28.760718 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e560ced7-c226-4a0b-81fc-b14103367748 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:28.761784 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e560ced7-c226-4a0b-81fc-b14103367748 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:28.762652 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e560ced7-c226-4a0b-81fc-b14103367748 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:28.778664 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-e560ced7-c226-4a0b-81fc-b14103367748 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e560ced7-c226-4a0b-81fc-b14103367748 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda HTTP/1.1 Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:33:28.780679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:33:28.782074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'a3afef28-40eb-48c6-a65c-f549cc963cda'} Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:33:28.783146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:33:28.784779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:33:28.786288 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e560ced7-c226-4a0b-81fc-b14103367748 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:33:28.786288 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e560ced7-c226-4a0b-81fc-b14103367748 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 404 len: 111 microversion: 2.1 time: 0.038831 Jun 27 15:33:28.786288 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 439/873] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:28 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:33:28.792674 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ce540da2-f24a-40e7-ab60-ff65e9dbf28f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '.version_select at 0x7fb27348c5e0>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:28.814928 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ce540da2-f24a-40e7-ab60-ff65e9dbf28f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827982800" status: 202 len: 0 microversion: 2.1 time: 0.026983 Jun 27 15:33:28.816473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 440/874] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jun 27 15:33:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1827982800 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:33:28.883312 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-54bda27a-f2c7-4f44-993c-05febe6903d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:28.896581 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-54bda27a-f2c7-4f44-993c-05febe6903d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:28.898307 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-54bda27a-f2c7-4f44-993c-05febe6903d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:28.899678 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-54bda27a-f2c7-4f44-993c-05febe6903d4 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1730 microversion: 2.20 time: 0.327946 Jun 27 15:33:28.900235 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 435/875] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:28 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1730 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:29.824748 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-20d37dae-f3fa-4fb3-9ac8-25c5a723d544 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: .version_select at 0x7fb2734d91f0>, body: {"keypair": {"name": "tempest-keypair-1034885159", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOvXoucto8VCuDxDtWRZdJn8i7Zz+O86RYgm1G8GcqayeRVJHTF+x93u9Q8dS1NvEH1Ic8pkCoLV/7bOlFh7KLOXLjDVUmQlICQb2kOTShJwbEbEr5a1c0dO0IOGIO93Ew=="}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:29.841241 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-20d37dae-f3fa-4fb3-9ac8-25c5a723d544 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for project dff1983b1b3047378b88d87d54aa709d. Resources: {'key_pairs'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:33:29.845493 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-20d37dae-f3fa-4fb3-9ac8-25c5a723d544 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for user 23abc809ab644c1da0270a35ac8bab21 and project dff1983b1b3047378b88d87d54aa709d. Resources: {'key_pairs'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:33:29.872226 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-20d37dae-f3fa-4fb3-9ac8-25c5a723d544 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.051998 Jun 27 15:33:29.872889 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 441/876] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jun 27 15:33:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:33:29.918413 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d9d927b5-ef04-4372-978a-c110b76e1939 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:29.919352 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d9d927b5-ef04-4372-978a-c110b76e1939 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:29.927757 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9d927b5-ef04-4372-978a-c110b76e1939 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:29.928424 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9d927b5-ef04-4372-978a-c110b76e1939 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:29.929466 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9d927b5-ef04-4372-978a-c110b76e1939 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:29.929916 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d9d927b5-ef04-4372-978a-c110b76e1939 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:30.154451 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d9d927b5-ef04-4372-978a-c110b76e1939 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:30.167244 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d9d927b5-ef04-4372-978a-c110b76e1939 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:30.169186 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d9d927b5-ef04-4372-978a-c110b76e1939 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:30.170462 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d9d927b5-ef04-4372-978a-c110b76e1939 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1717 microversion: 2.20 time: 0.256471 Jun 27 15:33:30.171035 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 436/877] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:33:29 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1717 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:33:31.435725 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1242130142", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f2b3a5f-8943-48e2-bb0f-3f837d61206a"}], "security_groups": [{"name": "tempest-securitygroup--1424189319"}], "key_name": "tempest-keypair-1034885159", "user_data": "}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:31.549493 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] validate_networks() for [('9f2b3a5f-8943-48e2-bb0f-3f837d61206a', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:33:31.901533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a627f691-9cca-4d77-ab0e-f5d8f8962f0f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:31.902898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a627f691-9cca-4d77-ab0e-f5d8f8962f0f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:31.905531 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:31.912491 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a627f691-9cca-4d77-ab0e-f5d8f8962f0f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:31.912952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a627f691-9cca-4d77-ab0e-f5d8f8962f0f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:31.913739 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a627f691-9cca-4d77-ab0e-f5d8f8962f0f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:31.914180 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a627f691-9cca-4d77-ab0e-f5d8f8962f0f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:31.930073 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-a627f691-9cca-4d77-ab0e-f5d8f8962f0f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] HTTP exception thrown: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a627f691-9cca-4d77-ab0e-f5d8f8962f0f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Request method failure captured: Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 HTTP/1.1 Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwyhrXvpCqPplKR8a98QVW12ooHNqCqz3XSZt4F1-ZWvgXF3_E0pDZdI1mpf1FP68Pt2IiSEj3mwGTFfKKSP6UuEMPBgq0a_li_vWxHfgwscJr-_9K5L_jGwrNrkYlIwdKmlfh79C7JTu_grOi_I79QkBbJRd7RLlkSFE7PpXtB-ig Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:33:31.931901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e07fc46cd5f4afe875767c926bd63ee", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 995fa1760f5241588a493e5f894b0e3f Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:31.934121 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '902ddcef-106e-4a57-a046-8ea9f13aa8a1'} Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:33:31.934982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:31.936585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:31.938773 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a627f691-9cca-4d77-ab0e-f5d8f8962f0f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Returning 404 to user: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:33:31.938773 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a627f691-9cca-4d77-ab0e-f5d8f8962f0f tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 404 len: 111 microversion: 2.1 time: 0.036263 Jun 27 15:33:31.938773 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 437/878] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:33:31 2022] DELETE /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:33:31.943834 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-39c23a5e-9579-4b6d-8fb8-50081b06ee6d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:31.944480 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-39c23a5e-9579-4b6d-8fb8-50081b06ee6d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 902ddcef-106e-4a57-a046-8ea9f13aa8a1] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:31.951618 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39c23a5e-9579-4b6d-8fb8-50081b06ee6d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:31.952199 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39c23a5e-9579-4b6d-8fb8-50081b06ee6d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:31.952930 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39c23a5e-9579-4b6d-8fb8-50081b06ee6d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:31.953369 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-39c23a5e-9579-4b6d-8fb8-50081b06ee6d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:31.968312 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-39c23a5e-9579-4b6d-8fb8-50081b06ee6d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] HTTP exception thrown: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-39c23a5e-9579-4b6d-8fb8-50081b06ee6d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Request method failure captured: Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 HTTP/1.1 Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwyhrXvpCqPplKR8a98QVW12ooHNqCqz3XSZt4F1-ZWvgXF3_E0pDZdI1mpf1FP68Pt2IiSEj3mwGTFfKKSP6UuEMPBgq0a_li_vWxHfgwscJr-_9K5L_jGwrNrkYlIwdKmlfh79C7JTu_grOi_I79QkBbJRd7RLlkSFE7PpXtB-ig Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:33:31.969876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e07fc46cd5f4afe875767c926bd63ee", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 995fa1760f5241588a493e5f894b0e3f Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:31.971664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '902ddcef-106e-4a57-a046-8ea9f13aa8a1'} Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:33:31.972600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. Jun 27 15:33:31.974086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:31.975451 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-39c23a5e-9579-4b6d-8fb8-50081b06ee6d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Returning 404 to user: Instance 902ddcef-106e-4a57-a046-8ea9f13aa8a1 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:33:31.975451 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-39c23a5e-9579-4b6d-8fb8-50081b06ee6d tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1" status: 404 len: 111 microversion: 2.1 time: 0.032959 Jun 27 15:33:31.975451 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 438/879] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:31 2022] GET /compute/v2.1/servers/902ddcef-106e-4a57-a046-8ea9f13aa8a1 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:33:32.240068 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:33:32.240558 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:33:32.241205 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:33:32.241741 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:33:32.242179 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:33:32.255815 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:32.256436 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:32.257666 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:32.258144 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:32.281673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for project dff1983b1b3047378b88d87d54aa709d. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:33:32.288101 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Getting quotas for user 23abc809ab644c1da0270a35ac8bab21 and project dff1983b1b3047378b88d87d54aa709d. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:33:32.301085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:33:32.303441 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:33:32.352188 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d4f51f05-3b39-4a97-94c0-e15e8a33df4f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.921610 Jun 27 15:33:32.353103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 442/880] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:33:31 2022] POST /compute/v2.1/servers => generated 402 bytes in 923 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:33:32.363438 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7637723d-cdcf-4d1d-b65c-c9ef3435ca1e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:32.364225 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7637723d-cdcf-4d1d-b65c-c9ef3435ca1e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:32.428300 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7637723d-cdcf-4d1d-b65c-c9ef3435ca1e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:32.436021 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7637723d-cdcf-4d1d-b65c-c9ef3435ca1e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1242 microversion: 2.1 time: 0.076604 Jun 27 15:33:32.436858 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 439/881] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:32 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:33.126291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-703907ca-4ec7-4fbd-9c4a-8151b48e47a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:33.126983 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-703907ca-4ec7-4fbd-9c4a-8151b48e47a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:33.133995 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-703907ca-4ec7-4fbd-9c4a-8151b48e47a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:33.134447 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-703907ca-4ec7-4fbd-9c4a-8151b48e47a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:33.135246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-703907ca-4ec7-4fbd-9c4a-8151b48e47a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:33.135680 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-703907ca-4ec7-4fbd-9c4a-8151b48e47a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:33.151839 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-703907ca-4ec7-4fbd-9c4a-8151b48e47a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] HTTP exception thrown: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-703907ca-4ec7-4fbd-9c4a-8151b48e47a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Request method failure captured: Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: DELETE /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d HTTP/1.1 Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwyhrXvpCqPplKR8a98QVW12ooHNqCqz3XSZt4F1-ZWvgXF3_E0pDZdI1mpf1FP68Pt2IiSEj3mwGTFfKKSP6UuEMPBgq0a_li_vWxHfgwscJr-_9K5L_jGwrNrkYlIwdKmlfh79C7JTu_grOi_I79QkBbJRd7RLlkSFE7PpXtB-ig Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:33:33.153669 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e07fc46cd5f4afe875767c926bd63ee", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 995fa1760f5241588a493e5f894b0e3f Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:33:33.155299 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '53705ab2-462b-4198-8565-c1ad2fbf535d'} Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:33:33.159761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:33:33.161291 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:33:33.162780 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-703907ca-4ec7-4fbd-9c4a-8151b48e47a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Returning 404 to user: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:33:33.162780 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-703907ca-4ec7-4fbd-9c4a-8151b48e47a0 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "DELETE /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 404 len: 111 microversion: 2.1 time: 0.034340 Jun 27 15:33:33.162780 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 443/882] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:33:33 2022] DELETE /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:33:33.165224 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-015faee5-4d0e-4736-9e1a-5797ef2620b9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:33.165838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-015faee5-4d0e-4736-9e1a-5797ef2620b9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] [instance: 53705ab2-462b-4198-8565-c1ad2fbf535d] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:33.175956 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-015faee5-4d0e-4736-9e1a-5797ef2620b9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:33.176471 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-015faee5-4d0e-4736-9e1a-5797ef2620b9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:33.177263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-015faee5-4d0e-4736-9e1a-5797ef2620b9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:33.177865 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-015faee5-4d0e-4736-9e1a-5797ef2620b9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:33.193468 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-015faee5-4d0e-4736-9e1a-5797ef2620b9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] HTTP exception thrown: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-015faee5-4d0e-4736-9e1a-5797ef2620b9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Request method failure captured: Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d HTTP/1.1 Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwyhrXvpCqPplKR8a98QVW12ooHNqCqz3XSZt4F1-ZWvgXF3_E0pDZdI1mpf1FP68Pt2IiSEj3mwGTFfKKSP6UuEMPBgq0a_li_vWxHfgwscJr-_9K5L_jGwrNrkYlIwdKmlfh79C7JTu_grOi_I79QkBbJRd7RLlkSFE7PpXtB-ig Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:33:33.195805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2e07fc46cd5f4afe875767c926bd63ee", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2e07fc46cd5f4afe875767c926bd63ee"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 2e07fc46cd5f4afe875767c926bd63ee Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1560043953 Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 995fa1760f5241588a493e5f894b0e3f Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeTestJSON-1560043953-project Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:33:33.197743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '53705ab2-462b-4198-8565-c1ad2fbf535d'} Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:33:33.199075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. Jun 27 15:33:33.201075 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:33:33.202786 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-015faee5-4d0e-4736-9e1a-5797ef2620b9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] Returning 404 to user: Instance 53705ab2-462b-4198-8565-c1ad2fbf535d could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:33:33.202786 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-015faee5-4d0e-4736-9e1a-5797ef2620b9 tempest-AttachVolumeTestJSON-1560043953 tempest-AttachVolumeTestJSON-1560043953-project] 10.222.0.26 "GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d" status: 404 len: 111 microversion: 2.1 time: 0.036712 Jun 27 15:33:33.202786 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 440/883] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:33 2022] GET /compute/v2.1/servers/53705ab2-462b-4198-8565-c1ad2fbf535d => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:33:33.454707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-da7c2395-4a62-4bd3-a6a7-c9969fa8ecc6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:33.455454 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-da7c2395-4a62-4bd3-a6a7-c9969fa8ecc6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:33.462225 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-da7c2395-4a62-4bd3-a6a7-c9969fa8ecc6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:33.462818 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-da7c2395-4a62-4bd3-a6a7-c9969fa8ecc6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:33.464380 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-da7c2395-4a62-4bd3-a6a7-c9969fa8ecc6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:33.464928 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-da7c2395-4a62-4bd3-a6a7-c9969fa8ecc6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:33.585456 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-da7c2395-4a62-4bd3-a6a7-c9969fa8ecc6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:33.594468 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-da7c2395-4a62-4bd3-a6a7-c9969fa8ecc6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1312 microversion: 2.1 time: 0.143735 Jun 27 15:33:33.595215 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 444/884] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:33 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1312 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:34.614473 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b0f4fb23-6b3c-4da6-a61e-e91992c86e8c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:34.615128 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b0f4fb23-6b3c-4da6-a61e-e91992c86e8c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:34.622102 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0f4fb23-6b3c-4da6-a61e-e91992c86e8c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:34.622550 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0f4fb23-6b3c-4da6-a61e-e91992c86e8c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:34.623323 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0f4fb23-6b3c-4da6-a61e-e91992c86e8c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:34.623758 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b0f4fb23-6b3c-4da6-a61e-e91992c86e8c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:34.777941 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b0f4fb23-6b3c-4da6-a61e-e91992c86e8c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:34.786782 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b0f4fb23-6b3c-4da6-a61e-e91992c86e8c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.178710 Jun 27 15:33:34.787535 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 441/885] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:34 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:35.804735 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-921e7fc3-126a-4713-9eac-7b6ababb4e10 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:35.805960 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-921e7fc3-126a-4713-9eac-7b6ababb4e10 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:35.814730 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-921e7fc3-126a-4713-9eac-7b6ababb4e10 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:35.816129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-921e7fc3-126a-4713-9eac-7b6ababb4e10 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:35.818298 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-921e7fc3-126a-4713-9eac-7b6ababb4e10 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:35.819314 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-921e7fc3-126a-4713-9eac-7b6ababb4e10 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:36.350593 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-921e7fc3-126a-4713-9eac-7b6ababb4e10 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:36.387678 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-75b1a760-3425-4b1d-87d4-b4c4c8cc02ef req-6f26966c-c02c-4e12-beb3-a3e8d0476760 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4010529e-f303-42fc-a783-e7983c3d43ed", "tag": "a86d0d76-5450-4083-8558-738baa5dd07f"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:36.399146 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-921e7fc3-126a-4713-9eac-7b6ababb4e10 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.564408 Jun 27 15:33:36.407901 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 445/886] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:35 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 608 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:36.420471 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-75b1a760-3425-4b1d-87d4-b4c4c8cc02ef req-6f26966c-c02c-4e12-beb3-a3e8d0476760 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:36.421173 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-75b1a760-3425-4b1d-87d4-b4c4c8cc02ef req-6f26966c-c02c-4e12-beb3-a3e8d0476760 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:36.453462 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-75b1a760-3425-4b1d-87d4-b4c4c8cc02ef req-6f26966c-c02c-4e12-beb3-a3e8d0476760 service nova] Creating event network-changed:a86d0d76-5450-4083-8558-738baa5dd07f for instance 4010529e-f303-42fc-a783-e7983c3d43ed on hv-cinder-84779 Jun 27 15:33:36.465643 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-75b1a760-3425-4b1d-87d4-b4c4c8cc02ef req-6f26966c-c02c-4e12-beb3-a3e8d0476760 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081332 Jun 27 15:33:36.466966 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 442/887] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:37.425406 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2f7250cd-824e-4f72-bde6-48b264662e65 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:37.426015 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2f7250cd-824e-4f72-bde6-48b264662e65 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:37.433184 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2f7250cd-824e-4f72-bde6-48b264662e65 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:37.433559 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2f7250cd-824e-4f72-bde6-48b264662e65 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:37.434354 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2f7250cd-824e-4f72-bde6-48b264662e65 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:37.434773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2f7250cd-824e-4f72-bde6-48b264662e65 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:37.621863 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2f7250cd-824e-4f72-bde6-48b264662e65 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:37.627334 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:37.632399 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2f7250cd-824e-4f72-bde6-48b264662e65 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.211149 Jun 27 15:33:37.632992 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 446/888] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:37 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:33:38.652484 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-22919242-2f5f-4845-9bb4-3932217046ca tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:38.654338 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-22919242-2f5f-4845-9bb4-3932217046ca tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:38.668143 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22919242-2f5f-4845-9bb4-3932217046ca tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:38.668831 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22919242-2f5f-4845-9bb4-3932217046ca tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:38.669698 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22919242-2f5f-4845-9bb4-3932217046ca tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:38.670136 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22919242-2f5f-4845-9bb4-3932217046ca tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:38.847246 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-22919242-2f5f-4845-9bb4-3932217046ca tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:38.855998 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-22919242-2f5f-4845-9bb4-3932217046ca tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.209516 Jun 27 15:33:38.856743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 443/889] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:38 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:39.126196 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-537150641", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1394865336", "security_groups": [{"name": "tempest-secgroup-smoke-1949729797"}], "networks": [{"uuid": "349d1b6e-5234-4dc2-99b2-1fa8dfb56b5f"}], "block_device_mapping_v2": [{"uuid": "769445cf-a22d-4179-93a0-388289540f6b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:39.262147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] validate_networks() for [('349d1b6e-5234-4dc2-99b2-1fa8dfb56b5f', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:33:39.685502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:33:39.685974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:33:39.686516 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:33:39.687109 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:33:39.687626 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:33:39.697427 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:39.697875 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:39.698676 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:39.699110 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:39.718175 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Getting quotas for project 9954040eb98d4ecdafbc681132689ff5. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:33:39.723405 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Getting quotas for user b35218bf5d284771b5107601ec633f7c and project 9954040eb98d4ecdafbc681132689ff5. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:33:39.786987 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:33:39.789311 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='769445cf-a22d-4179-93a0-388289540f6b',volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:33:39.874984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b1e2f012-558e-423c-bedf-4277532ded06 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:39.875563 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b1e2f012-558e-423c-bedf-4277532ded06 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:39.882717 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b1e2f012-558e-423c-bedf-4277532ded06 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:39.883165 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b1e2f012-558e-423c-bedf-4277532ded06 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:39.883935 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b1e2f012-558e-423c-bedf-4277532ded06 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:39.884601 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b1e2f012-558e-423c-bedf-4277532ded06 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:39.946697 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d0a9a230-b494-4b58-8241-8280121621a0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.825095 Jun 27 15:33:39.947345 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 447/890] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:33:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 826 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:33:39.960060 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2dc49e0c-be88-4e98-bb3e-2e8c203aa10c tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:39.960728 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2dc49e0c-be88-4e98-bb3e-2e8c203aa10c tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:40.019972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2dc49e0c-be88-4e98-bb3e-2e8c203aa10c tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:40.026820 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2dc49e0c-be88-4e98-bb3e-2e8c203aa10c tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1088 microversion: 2.1 time: 0.071657 Jun 27 15:33:40.038226 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 448/891] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:39 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1088 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:40.067682 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b1e2f012-558e-423c-bedf-4277532ded06 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:40.079574 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b1e2f012-558e-423c-bedf-4277532ded06 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.210387 Jun 27 15:33:40.080350 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 444/892] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:39 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:33:41.045608 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fa232e06-d70d-45c4-9020-4de20d8229e1 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:41.046255 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-fa232e06-d70d-45c4-9020-4de20d8229e1 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:41.061356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa232e06-d70d-45c4-9020-4de20d8229e1 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:41.064129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa232e06-d70d-45c4-9020-4de20d8229e1 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:41.065485 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa232e06-d70d-45c4-9020-4de20d8229e1 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:41.070994 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa232e06-d70d-45c4-9020-4de20d8229e1 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:41.099700 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f1f34bf4-f08a-4368-9440-0b579185251f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:41.100563 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f1f34bf4-f08a-4368-9440-0b579185251f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:41.119592 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f1f34bf4-f08a-4368-9440-0b579185251f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:41.131743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f1f34bf4-f08a-4368-9440-0b579185251f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:41.133814 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f1f34bf4-f08a-4368-9440-0b579185251f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:41.145433 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f1f34bf4-f08a-4368-9440-0b579185251f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:41.230912 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fa232e06-d70d-45c4-9020-4de20d8229e1 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:41.241785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fa232e06-d70d-45c4-9020-4de20d8229e1 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1194 microversion: 2.1 time: 0.200032 Jun 27 15:33:41.242418 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 449/893] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:41 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1194 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:41.322291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f1f34bf4-f08a-4368-9440-0b579185251f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:41.334035 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f1f34bf4-f08a-4368-9440-0b579185251f tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.239522 Jun 27 15:33:41.334960 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 445/894] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:41 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:42.259237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5bb0599d-da3d-45d3-b995-649a4b520979 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:42.260077 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5bb0599d-da3d-45d3-b995-649a4b520979 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:42.267023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5bb0599d-da3d-45d3-b995-649a4b520979 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:42.267488 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5bb0599d-da3d-45d3-b995-649a4b520979 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:42.268519 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5bb0599d-da3d-45d3-b995-649a4b520979 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:42.268964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5bb0599d-da3d-45d3-b995-649a4b520979 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:42.351952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9099e298-5a6e-4dba-a2b0-6e8b3a28c659 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:42.352760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9099e298-5a6e-4dba-a2b0-6e8b3a28c659 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:42.355390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:42.360965 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9099e298-5a6e-4dba-a2b0-6e8b3a28c659 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:42.361901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9099e298-5a6e-4dba-a2b0-6e8b3a28c659 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:42.362251 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9099e298-5a6e-4dba-a2b0-6e8b3a28c659 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:42.362903 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9099e298-5a6e-4dba-a2b0-6e8b3a28c659 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:42.433186 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:42.508440 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5bb0599d-da3d-45d3-b995-649a4b520979 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:42.522860 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5bb0599d-da3d-45d3-b995-649a4b520979 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.265986 Jun 27 15:33:42.524278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 450/895] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:42 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:42.593010 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9099e298-5a6e-4dba-a2b0-6e8b3a28c659 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:42.594279 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9099e298-5a6e-4dba-a2b0-6e8b3a28c659 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.246387 Jun 27 15:33:42.595529 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 446/896] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:42 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:33:42.880568 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-adc5cc05-b762-4a74-bdd4-db2f85a12d1b req-31f062d2-b4cb-4200-a9ed-90af8f65d172 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d3f4f1-4158-4a2f-8568-5cea794cdf31", "tag": "8a6da410-e6d2-40db-ac82-63f37c7545e0"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:42.902319 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-adc5cc05-b762-4a74-bdd4-db2f85a12d1b req-31f062d2-b4cb-4200-a9ed-90af8f65d172 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:42.902866 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-adc5cc05-b762-4a74-bdd4-db2f85a12d1b req-31f062d2-b4cb-4200-a9ed-90af8f65d172 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:42.918836 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-adc5cc05-b762-4a74-bdd4-db2f85a12d1b req-31f062d2-b4cb-4200-a9ed-90af8f65d172 service nova] Creating event network-changed:8a6da410-e6d2-40db-ac82-63f37c7545e0 for instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 on hv-cinder-84779 Jun 27 15:33:42.925657 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-adc5cc05-b762-4a74-bdd4-db2f85a12d1b req-31f062d2-b4cb-4200-a9ed-90af8f65d172 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051304 Jun 27 15:33:42.926667 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 451/897] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:43.081525 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-c7789fe1-c214-4d19-b153-62005f37f249 req-895b018d-c7f9-48f5-900a-3bf72efaea35 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4010529e-f303-42fc-a783-e7983c3d43ed", "name": "network-vif-plugged", "status": "completed", "tag": "a86d0d76-5450-4083-8558-738baa5dd07f"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:43.091282 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-c7789fe1-c214-4d19-b153-62005f37f249 req-895b018d-c7f9-48f5-900a-3bf72efaea35 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:43.091982 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-c7789fe1-c214-4d19-b153-62005f37f249 req-895b018d-c7f9-48f5-900a-3bf72efaea35 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:43.106800 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-c7789fe1-c214-4d19-b153-62005f37f249 req-895b018d-c7f9-48f5-900a-3bf72efaea35 service nova] Creating event network-vif-plugged:a86d0d76-5450-4083-8558-738baa5dd07f for instance 4010529e-f303-42fc-a783-e7983c3d43ed on hv-cinder-84779 Jun 27 15:33:43.113662 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-c7789fe1-c214-4d19-b153-62005f37f249 req-895b018d-c7f9-48f5-900a-3bf72efaea35 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035834 Jun 27 15:33:43.115194 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 447/898] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:33:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:43.541514 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-27cb5ac9-263a-467a-85d2-26d3c28cf61b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:43.542185 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-27cb5ac9-263a-467a-85d2-26d3c28cf61b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:43.551440 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-27cb5ac9-263a-467a-85d2-26d3c28cf61b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:43.551897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-27cb5ac9-263a-467a-85d2-26d3c28cf61b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:43.552686 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-27cb5ac9-263a-467a-85d2-26d3c28cf61b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:43.553109 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-27cb5ac9-263a-467a-85d2-26d3c28cf61b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:43.614043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8a10f1c6-3ef8-4015-a5a3-6f708ae164fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:43.614651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8a10f1c6-3ef8-4015-a5a3-6f708ae164fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:43.622530 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a10f1c6-3ef8-4015-a5a3-6f708ae164fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:43.622981 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a10f1c6-3ef8-4015-a5a3-6f708ae164fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:43.623759 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a10f1c6-3ef8-4015-a5a3-6f708ae164fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:43.624404 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8a10f1c6-3ef8-4015-a5a3-6f708ae164fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:43.629734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=100 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:43.693892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-27cb5ac9-263a-467a-85d2-26d3c28cf61b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:43.701808 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-27cb5ac9-263a-467a-85d2-26d3c28cf61b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.164693 Jun 27 15:33:43.702392 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 452/899] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:43 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:43.765590 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8a10f1c6-3ef8-4015-a5a3-6f708ae164fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:43.774378 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8a10f1c6-3ef8-4015-a5a3-6f708ae164fc tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.164851 Jun 27 15:33:43.775069 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 448/900] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:43 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:44.719059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-57a53c2d-5c8a-4f71-b104-a740d6eae659 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:44.719700 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-57a53c2d-5c8a-4f71-b104-a740d6eae659 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:44.727039 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-57a53c2d-5c8a-4f71-b104-a740d6eae659 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:44.727477 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-57a53c2d-5c8a-4f71-b104-a740d6eae659 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:44.728254 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-57a53c2d-5c8a-4f71-b104-a740d6eae659 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:44.728709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-57a53c2d-5c8a-4f71-b104-a740d6eae659 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:44.793213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b191b958-3386-4789-8bf7-6ab25669a92c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:44.793969 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b191b958-3386-4789-8bf7-6ab25669a92c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:44.801644 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b191b958-3386-4789-8bf7-6ab25669a92c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:44.802189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b191b958-3386-4789-8bf7-6ab25669a92c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:44.803144 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b191b958-3386-4789-8bf7-6ab25669a92c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:44.803645 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b191b958-3386-4789-8bf7-6ab25669a92c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:44.893929 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-57a53c2d-5c8a-4f71-b104-a740d6eae659 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:44.908524 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-57a53c2d-5c8a-4f71-b104-a740d6eae659 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.191988 Jun 27 15:33:44.908681 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 453/901] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:44 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:44.988122 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b191b958-3386-4789-8bf7-6ab25669a92c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:44.996395 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b191b958-3386-4789-8bf7-6ab25669a92c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.207645 Jun 27 15:33:44.996990 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 449/902] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:44 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:33:45.926267 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3fa07573-de70-4ca0-93c6-6e3c139bb657 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:45.926903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3fa07573-de70-4ca0-93c6-6e3c139bb657 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:45.934067 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3fa07573-de70-4ca0-93c6-6e3c139bb657 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:45.934513 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3fa07573-de70-4ca0-93c6-6e3c139bb657 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:45.935293 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3fa07573-de70-4ca0-93c6-6e3c139bb657 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:45.935718 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3fa07573-de70-4ca0-93c6-6e3c139bb657 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:46.014259 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c9e0cd37-878f-4acb-8cc4-8aa2f78dfd69 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:46.014901 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c9e0cd37-878f-4acb-8cc4-8aa2f78dfd69 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:46.022628 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9e0cd37-878f-4acb-8cc4-8aa2f78dfd69 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:46.023067 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9e0cd37-878f-4acb-8cc4-8aa2f78dfd69 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:46.023854 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9e0cd37-878f-4acb-8cc4-8aa2f78dfd69 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:46.024277 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c9e0cd37-878f-4acb-8cc4-8aa2f78dfd69 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:46.077292 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3fa07573-de70-4ca0-93c6-6e3c139bb657 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:46.085227 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3fa07573-de70-4ca0-93c6-6e3c139bb657 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.162956 Jun 27 15:33:46.085774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 454/903] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:45 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:46.165600 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c9e0cd37-878f-4acb-8cc4-8aa2f78dfd69 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:46.174178 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c9e0cd37-878f-4acb-8cc4-8aa2f78dfd69 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.163710 Jun 27 15:33:46.174841 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 450/904] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:46 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:47.103023 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-95fb13ec-8591-4de1-b2fa-9c40b7ba9801 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:47.103642 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-95fb13ec-8591-4de1-b2fa-9c40b7ba9801 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:47.106097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=91,nova_api:DELETE=2,nova_api:INSERT=7 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:47.111738 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-95fb13ec-8591-4de1-b2fa-9c40b7ba9801 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:47.112216 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-95fb13ec-8591-4de1-b2fa-9c40b7ba9801 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:47.113011 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-95fb13ec-8591-4de1-b2fa-9c40b7ba9801 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:47.113455 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-95fb13ec-8591-4de1-b2fa-9c40b7ba9801 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:47.193401 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-78b5b2be-91a8-4f71-98ef-9b987a81bafa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:47.194518 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-78b5b2be-91a8-4f71-98ef-9b987a81bafa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:47.202590 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78b5b2be-91a8-4f71-98ef-9b987a81bafa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:47.203044 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78b5b2be-91a8-4f71-98ef-9b987a81bafa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:47.203807 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78b5b2be-91a8-4f71-98ef-9b987a81bafa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:47.204241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-78b5b2be-91a8-4f71-98ef-9b987a81bafa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:47.258017 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-95fb13ec-8591-4de1-b2fa-9c40b7ba9801 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:47.265892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-95fb13ec-8591-4de1-b2fa-9c40b7ba9801 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.166860 Jun 27 15:33:47.266458 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 455/905] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:47 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:47.351964 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-78b5b2be-91a8-4f71-98ef-9b987a81bafa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:47.365782 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-78b5b2be-91a8-4f71-98ef-9b987a81bafa tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1368 microversion: 2.1 time: 0.177410 Jun 27 15:33:47.366684 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 451/906] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:47 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1368 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:33:48.284410 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-13047505-a1a6-4b1e-a1dd-32a5a3c52fcd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:48.285251 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-13047505-a1a6-4b1e-a1dd-32a5a3c52fcd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:48.292090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-13047505-a1a6-4b1e-a1dd-32a5a3c52fcd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:48.292553 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-13047505-a1a6-4b1e-a1dd-32a5a3c52fcd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:48.293391 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-13047505-a1a6-4b1e-a1dd-32a5a3c52fcd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:48.293768 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-13047505-a1a6-4b1e-a1dd-32a5a3c52fcd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:48.383952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1c2cef37-8656-44fa-af53-4d6808de25de tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:48.384865 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1c2cef37-8656-44fa-af53-4d6808de25de tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:48.392918 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c2cef37-8656-44fa-af53-4d6808de25de tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:48.393952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c2cef37-8656-44fa-af53-4d6808de25de tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:48.394768 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c2cef37-8656-44fa-af53-4d6808de25de tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:48.395205 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1c2cef37-8656-44fa-af53-4d6808de25de tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:48.544213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1c2cef37-8656-44fa-af53-4d6808de25de tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:48.553712 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1c2cef37-8656-44fa-af53-4d6808de25de tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1557 microversion: 2.1 time: 0.173980 Jun 27 15:33:48.554317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 452/907] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:48 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1557 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:48.577194 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0bd7d14c-6c52-4ec5-824d-f0d930ab85c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:48.577690 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0bd7d14c-6c52-4ec5-824d-f0d930ab85c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:48.585147 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bd7d14c-6c52-4ec5-824d-f0d930ab85c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:48.585585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bd7d14c-6c52-4ec5-824d-f0d930ab85c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:48.586395 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bd7d14c-6c52-4ec5-824d-f0d930ab85c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:48.586830 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0bd7d14c-6c52-4ec5-824d-f0d930ab85c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:48.689472 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0bd7d14c-6c52-4ec5-824d-f0d930ab85c4 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.116112 Jun 27 15:33:48.691033 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 453/908] 10.222.0.26 () {58 vars in 1274 bytes} [Mon Jun 27 15:33:48 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/os-interface => generated 284 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:33:48.743049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-13047505-a1a6-4b1e-a1dd-32a5a3c52fcd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:48.750720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-13047505-a1a6-4b1e-a1dd-32a5a3c52fcd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.471145 Jun 27 15:33:48.751598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 456/909] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:48 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:49.774026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4f0b8703-c8cf-4b6e-87f0-975385400414 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:49.774732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4f0b8703-c8cf-4b6e-87f0-975385400414 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:49.781386 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f0b8703-c8cf-4b6e-87f0-975385400414 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:49.781965 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f0b8703-c8cf-4b6e-87f0-975385400414 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:49.782838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f0b8703-c8cf-4b6e-87f0-975385400414 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:49.783333 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4f0b8703-c8cf-4b6e-87f0-975385400414 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:49.910188 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-da82ac72-f5af-4bc3-99e2-51281c69b567 req-8b770860-9887-4337-9cf0-4a00b30d7d34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4010529e-f303-42fc-a783-e7983c3d43ed", "tag": "a86d0d76-5450-4083-8558-738baa5dd07f"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:49.918691 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=4 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:49.929362 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-da82ac72-f5af-4bc3-99e2-51281c69b567 req-8b770860-9887-4337-9cf0-4a00b30d7d34 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:49.930005 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-da82ac72-f5af-4bc3-99e2-51281c69b567 req-8b770860-9887-4337-9cf0-4a00b30d7d34 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:49.947174 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-da82ac72-f5af-4bc3-99e2-51281c69b567 req-8b770860-9887-4337-9cf0-4a00b30d7d34 service nova] Creating event network-changed:a86d0d76-5450-4083-8558-738baa5dd07f for instance 4010529e-f303-42fc-a783-e7983c3d43ed on hv-cinder-84779 Jun 27 15:33:49.952469 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-da82ac72-f5af-4bc3-99e2-51281c69b567 req-8b770860-9887-4337-9cf0-4a00b30d7d34 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049698 Jun 27 15:33:49.953375 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 457/910] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:33:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:49.979805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4f0b8703-c8cf-4b6e-87f0-975385400414 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:49.988893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4f0b8703-c8cf-4b6e-87f0-975385400414 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.219984 Jun 27 15:33:49.989881 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 454/911] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:49 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:51.010832 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=18 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:33:51.015657 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-48937559-2e0d-4350-8df9-25dcbf4a17b9 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:51.016411 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-48937559-2e0d-4350-8df9-25dcbf4a17b9 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:51.024302 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-48937559-2e0d-4350-8df9-25dcbf4a17b9 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:51.024792 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-48937559-2e0d-4350-8df9-25dcbf4a17b9 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:51.025554 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-48937559-2e0d-4350-8df9-25dcbf4a17b9 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:51.025988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-48937559-2e0d-4350-8df9-25dcbf4a17b9 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:51.250917 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-48937559-2e0d-4350-8df9-25dcbf4a17b9 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:51.261017 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-48937559-2e0d-4350-8df9-25dcbf4a17b9 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.250818 Jun 27 15:33:51.261616 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 458/912] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:51 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:52.278907 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7441f4be-227d-4dda-bc6b-3f1d1bdabf80 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:52.279528 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7441f4be-227d-4dda-bc6b-3f1d1bdabf80 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:52.287566 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7441f4be-227d-4dda-bc6b-3f1d1bdabf80 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:52.288013 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7441f4be-227d-4dda-bc6b-3f1d1bdabf80 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:52.288851 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7441f4be-227d-4dda-bc6b-3f1d1bdabf80 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:52.289296 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7441f4be-227d-4dda-bc6b-3f1d1bdabf80 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:52.440711 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7441f4be-227d-4dda-bc6b-3f1d1bdabf80 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:52.453471 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7441f4be-227d-4dda-bc6b-3f1d1bdabf80 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.178098 Jun 27 15:33:52.454376 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 455/913] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:52 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:53.471858 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f3a776a1-ee50-49e0-9363-31d3e6a658d8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:53.472657 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f3a776a1-ee50-49e0-9363-31d3e6a658d8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:53.480656 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f3a776a1-ee50-49e0-9363-31d3e6a658d8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:53.481598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f3a776a1-ee50-49e0-9363-31d3e6a658d8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:53.482794 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f3a776a1-ee50-49e0-9363-31d3e6a658d8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:53.483407 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f3a776a1-ee50-49e0-9363-31d3e6a658d8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:53.644469 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f3a776a1-ee50-49e0-9363-31d3e6a658d8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:53.653306 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f3a776a1-ee50-49e0-9363-31d3e6a658d8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.185588 Jun 27 15:33:53.659587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 459/914] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:53 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:54.671774 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-099b361e-9f79-400f-a61d-ab9be2d7b94b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:54.672416 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-099b361e-9f79-400f-a61d-ab9be2d7b94b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:54.679587 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-099b361e-9f79-400f-a61d-ab9be2d7b94b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:54.680051 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-099b361e-9f79-400f-a61d-ab9be2d7b94b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:54.680850 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-099b361e-9f79-400f-a61d-ab9be2d7b94b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:54.681291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-099b361e-9f79-400f-a61d-ab9be2d7b94b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:54.833041 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-099b361e-9f79-400f-a61d-ab9be2d7b94b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:54.842671 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-099b361e-9f79-400f-a61d-ab9be2d7b94b tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.174842 Jun 27 15:33:54.843270 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 456/915] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:54 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:55.137351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-f4bc85e7-09a3-4016-862a-5a644be530f7 req-9700bf1c-336b-4616-8e05-0cb2f198ae22 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d3f4f1-4158-4a2f-8568-5cea794cdf31", "name": "network-vif-plugged", "status": "completed", "tag": "8a6da410-e6d2-40db-ac82-63f37c7545e0"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:33:55.155360 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-f4bc85e7-09a3-4016-862a-5a644be530f7 req-9700bf1c-336b-4616-8e05-0cb2f198ae22 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:55.156252 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-f4bc85e7-09a3-4016-862a-5a644be530f7 req-9700bf1c-336b-4616-8e05-0cb2f198ae22 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:55.174327 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-f4bc85e7-09a3-4016-862a-5a644be530f7 req-9700bf1c-336b-4616-8e05-0cb2f198ae22 service nova] Creating event network-vif-plugged:8a6da410-e6d2-40db-ac82-63f37c7545e0 for instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 on hv-cinder-84779 Jun 27 15:33:55.180417 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-f4bc85e7-09a3-4016-862a-5a644be530f7 req-9700bf1c-336b-4616-8e05-0cb2f198ae22 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051020 Jun 27 15:33:55.181275 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 460/916] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:33:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:33:55.861264 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d4c7561c-c8eb-4209-882f-954bf7055f4e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:55.862610 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d4c7561c-c8eb-4209-882f-954bf7055f4e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:55.868947 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4c7561c-c8eb-4209-882f-954bf7055f4e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:55.869404 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4c7561c-c8eb-4209-882f-954bf7055f4e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:55.870184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4c7561c-c8eb-4209-882f-954bf7055f4e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:55.870617 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d4c7561c-c8eb-4209-882f-954bf7055f4e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:56.018571 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d4c7561c-c8eb-4209-882f-954bf7055f4e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:56.035316 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d4c7561c-c8eb-4209-882f-954bf7055f4e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.178166 Jun 27 15:33:56.035924 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 457/917] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:55 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:57.062070 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-eef76dc1-cf3a-438e-944e-47501ac473be tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:57.062732 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-eef76dc1-cf3a-438e-944e-47501ac473be tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:57.069688 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eef76dc1-cf3a-438e-944e-47501ac473be tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:57.070128 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eef76dc1-cf3a-438e-944e-47501ac473be tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:57.070878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eef76dc1-cf3a-438e-944e-47501ac473be tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:57.071305 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-eef76dc1-cf3a-438e-944e-47501ac473be tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:57.220897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-eef76dc1-cf3a-438e-944e-47501ac473be tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:57.229187 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-eef76dc1-cf3a-438e-944e-47501ac473be tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.172975 Jun 27 15:33:57.230053 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 461/918] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:57 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:58.253391 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-558fa161-ead3-45da-8573-97796b3baf21 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:58.254280 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-558fa161-ead3-45da-8573-97796b3baf21 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:58.262033 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-558fa161-ead3-45da-8573-97796b3baf21 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:58.262478 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-558fa161-ead3-45da-8573-97796b3baf21 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:58.263258 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-558fa161-ead3-45da-8573-97796b3baf21 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:58.263697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-558fa161-ead3-45da-8573-97796b3baf21 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:58.407462 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-558fa161-ead3-45da-8573-97796b3baf21 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:58.416131 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-558fa161-ead3-45da-8573-97796b3baf21 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.168498 Jun 27 15:33:58.424361 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 458/919] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:58 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:33:59.434664 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-aef10e47-2a2d-4ac8-916e-d32e44a7b522 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:33:59.435268 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-aef10e47-2a2d-4ac8-916e-d32e44a7b522 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:33:59.442757 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aef10e47-2a2d-4ac8-916e-d32e44a7b522 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:59.443206 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aef10e47-2a2d-4ac8-916e-d32e44a7b522 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:59.443965 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aef10e47-2a2d-4ac8-916e-d32e44a7b522 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:33:59.444422 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aef10e47-2a2d-4ac8-916e-d32e44a7b522 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:33:59.601109 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-aef10e47-2a2d-4ac8-916e-d32e44a7b522 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:33:59.610121 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-aef10e47-2a2d-4ac8-916e-d32e44a7b522 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.179723 Jun 27 15:33:59.610728 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 462/920] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:33:59 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:34:00.631433 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f5129832-84a4-47ae-8b09-ed236ce905b5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:00.632134 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f5129832-84a4-47ae-8b09-ed236ce905b5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:00.639541 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f5129832-84a4-47ae-8b09-ed236ce905b5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:00.639988 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f5129832-84a4-47ae-8b09-ed236ce905b5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:00.640830 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f5129832-84a4-47ae-8b09-ed236ce905b5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:00.641289 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f5129832-84a4-47ae-8b09-ed236ce905b5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:00.801267 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f5129832-84a4-47ae-8b09-ed236ce905b5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:00.810153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f5129832-84a4-47ae-8b09-ed236ce905b5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.182641 Jun 27 15:34:00.810732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 459/921] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:00 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:34:01.827489 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-7af62e9a-19ee-489c-8e0c-54f6a1d23e53 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:01.828242 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-7af62e9a-19ee-489c-8e0c-54f6a1d23e53 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:01.835455 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7af62e9a-19ee-489c-8e0c-54f6a1d23e53 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:01.835848 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7af62e9a-19ee-489c-8e0c-54f6a1d23e53 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:01.836981 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7af62e9a-19ee-489c-8e0c-54f6a1d23e53 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:01.837410 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-7af62e9a-19ee-489c-8e0c-54f6a1d23e53 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:01.987308 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-7af62e9a-19ee-489c-8e0c-54f6a1d23e53 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:01.995177 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-7af62e9a-19ee-489c-8e0c-54f6a1d23e53 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1260 microversion: 2.1 time: 0.171747 Jun 27 15:34:01.995771 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 463/922] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:01 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:34:03.013692 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9153d0ed-ab05-4f9a-9734-7d9cef0d4343 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:03.014303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9153d0ed-ab05-4f9a-9734-7d9cef0d4343 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:03.021156 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9153d0ed-ab05-4f9a-9734-7d9cef0d4343 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:03.021606 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9153d0ed-ab05-4f9a-9734-7d9cef0d4343 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:03.022645 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9153d0ed-ab05-4f9a-9734-7d9cef0d4343 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:03.022790 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9153d0ed-ab05-4f9a-9734-7d9cef0d4343 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:03.169346 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9153d0ed-ab05-4f9a-9734-7d9cef0d4343 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:03.178838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9153d0ed-ab05-4f9a-9734-7d9cef0d4343 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1445 microversion: 2.1 time: 0.169461 Jun 27 15:34:03.179386 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 460/923] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:03 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1445 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:34:03.195817 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-25c0dbef-abae-49bf-9a92-988e23bc92d4 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:03.196598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-25c0dbef-abae-49bf-9a92-988e23bc92d4 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:03.204200 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-25c0dbef-abae-49bf-9a92-988e23bc92d4 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:03.204829 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-25c0dbef-abae-49bf-9a92-988e23bc92d4 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:03.205606 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-25c0dbef-abae-49bf-9a92-988e23bc92d4 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:03.206037 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-25c0dbef-abae-49bf-9a92-988e23bc92d4 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:03.354467 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-25c0dbef-abae-49bf-9a92-988e23bc92d4 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:03.365108 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-25c0dbef-abae-49bf-9a92-988e23bc92d4 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1445 microversion: 2.1 time: 0.173537 Jun 27 15:34:03.365740 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 464/924] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:03 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1445 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:34:05.516277 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-f0e253f2-4aaa-4bdd-bc37-dd917d9e4dab req-78233705-35de-4bb3-ac80-7308b0e177e0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d3f4f1-4158-4a2f-8568-5cea794cdf31", "tag": "8a6da410-e6d2-40db-ac82-63f37c7545e0"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:34:05.525944 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f0e253f2-4aaa-4bdd-bc37-dd917d9e4dab req-78233705-35de-4bb3-ac80-7308b0e177e0 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:05.526548 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-f0e253f2-4aaa-4bdd-bc37-dd917d9e4dab req-78233705-35de-4bb3-ac80-7308b0e177e0 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:05.539713 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-f0e253f2-4aaa-4bdd-bc37-dd917d9e4dab req-78233705-35de-4bb3-ac80-7308b0e177e0 service nova] Creating event network-changed:8a6da410-e6d2-40db-ac82-63f37c7545e0 for instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 on hv-cinder-84779 Jun 27 15:34:05.545184 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-f0e253f2-4aaa-4bdd-bc37-dd917d9e4dab req-78233705-35de-4bb3-ac80-7308b0e177e0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032610 Jun 27 15:34:05.545975 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 461/925] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:34:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:34:09.377592 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e83e35e8-7121-477b-9af6-d4914a3ac91c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:09.378533 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e83e35e8-7121-477b-9af6-d4914a3ac91c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:09.387643 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e83e35e8-7121-477b-9af6-d4914a3ac91c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:09.388092 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e83e35e8-7121-477b-9af6-d4914a3ac91c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:09.389272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e83e35e8-7121-477b-9af6-d4914a3ac91c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:09.389987 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e83e35e8-7121-477b-9af6-d4914a3ac91c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:09.393872 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=88 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:09.431712 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e83e35e8-7121-477b-9af6-d4914a3ac91c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058161 Jun 27 15:34:09.432689 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 465/926] 10.222.0.26 () {60 vars in 1342 bytes} [Mon Jun 27 15:34:09 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:34:09.505872 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b1ddc1fd-8900-4c73-8bfc-4f286a8b9322 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:09.506744 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b1ddc1fd-8900-4c73-8bfc-4f286a8b9322 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:09.513012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b1ddc1fd-8900-4c73-8bfc-4f286a8b9322 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:09.513454 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b1ddc1fd-8900-4c73-8bfc-4f286a8b9322 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:09.514228 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b1ddc1fd-8900-4c73-8bfc-4f286a8b9322 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:09.514659 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b1ddc1fd-8900-4c73-8bfc-4f286a8b9322 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:09.541892 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b1ddc1fd-8900-4c73-8bfc-4f286a8b9322 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:34:09.634725 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b1ddc1fd-8900-4c73-8bfc-4f286a8b9322 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "DELETE /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 204 len: 0 microversion: 2.20 time: 0.135352 Jun 27 15:34:09.635515 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 462/927] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jun 27 15:34:09 2022] DELETE /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 15:34:09.644713 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-203a0e50-92e2-4e8e-8e37-5e42fb2598ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:09.645324 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-203a0e50-92e2-4e8e-8e37-5e42fb2598ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:09.652504 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-203a0e50-92e2-4e8e-8e37-5e42fb2598ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:09.653216 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-203a0e50-92e2-4e8e-8e37-5e42fb2598ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:09.653986 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-203a0e50-92e2-4e8e-8e37-5e42fb2598ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:09.654413 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-203a0e50-92e2-4e8e-8e37-5e42fb2598ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:09.802269 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-203a0e50-92e2-4e8e-8e37-5e42fb2598ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:09.813732 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-203a0e50-92e2-4e8e-8e37-5e42fb2598ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:09.815720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-203a0e50-92e2-4e8e-8e37-5e42fb2598ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:09.816929 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-203a0e50-92e2-4e8e-8e37-5e42fb2598ae tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.177119 Jun 27 15:34:09.817550 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 466/928] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:34:09 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:34:10.838030 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-42ea4c18-8284-42b9-bd42-8ca0e646f779 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:10.838726 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-42ea4c18-8284-42b9-bd42-8ca0e646f779 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:10.845653 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42ea4c18-8284-42b9-bd42-8ca0e646f779 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:10.846103 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42ea4c18-8284-42b9-bd42-8ca0e646f779 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:10.846881 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42ea4c18-8284-42b9-bd42-8ca0e646f779 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:10.847913 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-42ea4c18-8284-42b9-bd42-8ca0e646f779 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:10.991969 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-42ea4c18-8284-42b9-bd42-8ca0e646f779 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:11.000398 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-42ea4c18-8284-42b9-bd42-8ca0e646f779 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:11.001928 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-42ea4c18-8284-42b9-bd42-8ca0e646f779 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:11.003109 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-42ea4c18-8284-42b9-bd42-8ca0e646f779 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.169499 Jun 27 15:34:11.004493 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 463/929] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:34:10 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:34:12.024059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-32f81b80-2980-41ec-9ad4-29ef459b699c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:12.025008 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-32f81b80-2980-41ec-9ad4-29ef459b699c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:12.031945 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-32f81b80-2980-41ec-9ad4-29ef459b699c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:12.032352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-32f81b80-2980-41ec-9ad4-29ef459b699c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:12.033274 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-32f81b80-2980-41ec-9ad4-29ef459b699c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:12.033571 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-32f81b80-2980-41ec-9ad4-29ef459b699c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:12.190844 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-32f81b80-2980-41ec-9ad4-29ef459b699c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:12.202898 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-32f81b80-2980-41ec-9ad4-29ef459b699c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:12.204853 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-32f81b80-2980-41ec-9ad4-29ef459b699c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:12.206565 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-32f81b80-2980-41ec-9ad4-29ef459b699c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.186243 Jun 27 15:34:12.207432 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 467/930] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:34:12 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:34:13.225120 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1892df69-4173-43e1-bd97-458a7254d93c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:13.225772 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1892df69-4173-43e1-bd97-458a7254d93c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:13.228277 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:13.234739 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1892df69-4173-43e1-bd97-458a7254d93c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:13.235412 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1892df69-4173-43e1-bd97-458a7254d93c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:13.236371 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1892df69-4173-43e1-bd97-458a7254d93c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:13.236811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1892df69-4173-43e1-bd97-458a7254d93c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:13.241805 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:13.393819 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1892df69-4173-43e1-bd97-458a7254d93c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:13.402801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1892df69-4173-43e1-bd97-458a7254d93c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:13.404296 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1892df69-4173-43e1-bd97-458a7254d93c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:13.405489 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1892df69-4173-43e1-bd97-458a7254d93c tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1723 microversion: 2.20 time: 0.184599 Jun 27 15:34:13.406091 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 464/931] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:34:13 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:34:14.276347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-9b6b6e36-6c7f-453c-8c1e-b709f03d5562 req-33d7a847-7e1e-4e71-9403-fed1392ec45c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "886a9b39-9d64-4359-8d03-b07dbe1abf9c", "name": "network-vif-deleted", "tag": "82ee23e2-cf54-4c80-aa3a-825aa5c81193"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:34:14.289137 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-9b6b6e36-6c7f-453c-8c1e-b709f03d5562 req-33d7a847-7e1e-4e71-9403-fed1392ec45c service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:14.289721 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-9b6b6e36-6c7f-453c-8c1e-b709f03d5562 req-33d7a847-7e1e-4e71-9403-fed1392ec45c service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:14.302679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-9b6b6e36-6c7f-453c-8c1e-b709f03d5562 req-33d7a847-7e1e-4e71-9403-fed1392ec45c service nova] Creating event network-vif-deleted:82ee23e2-cf54-4c80-aa3a-825aa5c81193 for instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c on hv-cinder-84779 Jun 27 15:34:14.309494 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-9b6b6e36-6c7f-453c-8c1e-b709f03d5562 req-33d7a847-7e1e-4e71-9403-fed1392ec45c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037039 Jun 27 15:34:14.310613 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 468/932] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:34:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:34:14.432724 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:14.434410 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:14.443532 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:14.444292 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:14.445288 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:14.446083 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:14.493633 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:14.494322 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:14.494939 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lazy-loading 'fault' on Instance uuid 886a9b39-9d64-4359-8d03-b07dbe1abf9c {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:34:14.551507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:14.563359 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:14.565242 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'e9dab30db0a44655828384db53df29f9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2270daf238a640609e9ab514b01d9768', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:14.567263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a6d767b3-aa3c-4f0e-a216-ba98acaec76d tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 200 len: 1371 microversion: 2.20 time: 0.145992 Jun 27 15:34:14.577644 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 465/933] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:34:14 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 1371 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 15:34:15.588153 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-77532bf9-bb12-4c5b-9d83-9979669cc1d1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:15.588756 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-77532bf9-bb12-4c5b-9d83-9979669cc1d1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:15.597639 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77532bf9-bb12-4c5b-9d83-9979669cc1d1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:15.598060 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77532bf9-bb12-4c5b-9d83-9979669cc1d1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:15.598855 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77532bf9-bb12-4c5b-9d83-9979669cc1d1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:15.599281 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-77532bf9-bb12-4c5b-9d83-9979669cc1d1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:15.613415 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-77532bf9-bb12-4c5b-9d83-9979669cc1d1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] HTTP exception thrown: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-77532bf9-bb12-4c5b-9d83-9979669cc1d1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Request method failure captured: Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c HTTP/1.1 Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwzJwIGTsE3cSGbwc0yM_dXyHrCZE3lJKshl297HIXJNMWy8k0GI_Eu5U6EqQfyUsckbTEuanQJUvay9ZpSoXtqyrhaI5dSzOg_9QHzWNqlV-wbBHntm5i-OH9La2rBcmiEJ8ZYmtvWrYI9Bted2oj7y0rvmpApXRpslcz9SflcmKM Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:34:15.615323 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2270daf238a640609e9ab514b01d9768", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2270daf238a640609e9ab514b01d9768"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: e9dab30db0a44655828384db53df29f9 Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:15.617192 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '886a9b39-9d64-4359-8d03-b07dbe1abf9c'} Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:15.618021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:15.619297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:15.620460 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-77532bf9-bb12-4c5b-9d83-9979669cc1d1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Returning 404 to user: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:15.620460 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-77532bf9-bb12-4c5b-9d83-9979669cc1d1 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 404 len: 111 microversion: 2.20 time: 0.034409 Jun 27 15:34:15.620460 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 469/934] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:34:15 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:34:15.626056 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bdfd308c-f166-4c99-bc24-0358f334ff45 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '.version_select at 0x7fb2736ce3a0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:15.646366 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bdfd308c-f166-4c99-bc24-0358f334ff45 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863617111" status: 204 len: 0 microversion: 2.20 time: 0.024280 Jun 27 15:34:15.646947 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 466/935] 10.222.0.26 () {60 vars in 1261 bytes} [Mon Jun 27 15:34:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1863617111 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 15:34:18.515479 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-32e807b3-7afa-4b46-b30b-c16c279e9267 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:18.516075 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-32e807b3-7afa-4b46-b30b-c16c279e9267 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:18.518748 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=30 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:18.524833 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-32e807b3-7afa-4b46-b30b-c16c279e9267 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:18.525278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-32e807b3-7afa-4b46-b30b-c16c279e9267 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:18.526046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-32e807b3-7afa-4b46-b30b-c16c279e9267 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:18.526474 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-32e807b3-7afa-4b46-b30b-c16c279e9267 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:18.541666 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-32e807b3-7afa-4b46-b30b-c16c279e9267 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] HTTP exception thrown: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-32e807b3-7afa-4b46-b30b-c16c279e9267 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Request method failure captured: Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: DELETE /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c HTTP/1.1 Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwzJwIGTsE3cSGbwc0yM_dXyHrCZE3lJKshl297HIXJNMWy8k0GI_Eu5U6EqQfyUsckbTEuanQJUvay9ZpSoXtqyrhaI5dSzOg_9QHzWNqlV-wbBHntm5i-OH9La2rBcmiEJ8ZYmtvWrYI9Bted2oj7y0rvmpApXRpslcz9SflcmKM Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:34:18.543249 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2270daf238a640609e9ab514b01d9768", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2270daf238a640609e9ab514b01d9768"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: e9dab30db0a44655828384db53df29f9 Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:18.544861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '886a9b39-9d64-4359-8d03-b07dbe1abf9c'} Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:18.545695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:18.547157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:18.548677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-32e807b3-7afa-4b46-b30b-c16c279e9267 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Returning 404 to user: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:18.548677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-32e807b3-7afa-4b46-b30b-c16c279e9267 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "DELETE /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 404 len: 111 microversion: 2.20 time: 0.034157 Jun 27 15:34:18.548677 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 470/936] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jun 27 15:34:18 2022] DELETE /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:34:18.554571 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-465a9e40-c0fa-4299-9f89-3b0f376d7d3f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:18.555177 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-465a9e40-c0fa-4299-9f89-3b0f376d7d3f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 886a9b39-9d64-4359-8d03-b07dbe1abf9c] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:18.565515 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-465a9e40-c0fa-4299-9f89-3b0f376d7d3f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:18.565963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-465a9e40-c0fa-4299-9f89-3b0f376d7d3f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:18.566734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-465a9e40-c0fa-4299-9f89-3b0f376d7d3f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:18.567164 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-465a9e40-c0fa-4299-9f89-3b0f376d7d3f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:18.582357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-465a9e40-c0fa-4299-9f89-3b0f376d7d3f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] HTTP exception thrown: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-465a9e40-c0fa-4299-9f89-3b0f376d7d3f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Request method failure captured: Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c HTTP/1.1 Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwzJwIGTsE3cSGbwc0yM_dXyHrCZE3lJKshl297HIXJNMWy8k0GI_Eu5U6EqQfyUsckbTEuanQJUvay9ZpSoXtqyrhaI5dSzOg_9QHzWNqlV-wbBHntm5i-OH9La2rBcmiEJ8ZYmtvWrYI9Bted2oj7y0rvmpApXRpslcz9SflcmKM Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:34:18.584784 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2270daf238a640609e9ab514b01d9768", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2270daf238a640609e9ab514b01d9768"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: e9dab30db0a44655828384db53df29f9 Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:18.586573 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '886a9b39-9d64-4359-8d03-b07dbe1abf9c'} Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:18.587622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. Jun 27 15:34:18.589357 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:18.590654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-465a9e40-c0fa-4299-9f89-3b0f376d7d3f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Returning 404 to user: Instance 886a9b39-9d64-4359-8d03-b07dbe1abf9c could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:18.590654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-465a9e40-c0fa-4299-9f89-3b0f376d7d3f tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c" status: 404 len: 111 microversion: 2.20 time: 0.036581 Jun 27 15:34:18.590654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 467/937] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:34:18 2022] GET /compute/v2.1/servers/886a9b39-9d64-4359-8d03-b07dbe1abf9c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:34:19.733448 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-056c48d8-11ec-4fc8-b576-cf65d08d6bc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:19.733988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-056c48d8-11ec-4fc8-b576-cf65d08d6bc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:19.740981 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-056c48d8-11ec-4fc8-b576-cf65d08d6bc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:19.741408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-056c48d8-11ec-4fc8-b576-cf65d08d6bc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:19.742196 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-056c48d8-11ec-4fc8-b576-cf65d08d6bc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:19.742624 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-056c48d8-11ec-4fc8-b576-cf65d08d6bc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:19.757057 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-056c48d8-11ec-4fc8-b576-cf65d08d6bc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] HTTP exception thrown: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-056c48d8-11ec-4fc8-b576-cf65d08d6bc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Request method failure captured: Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: DELETE /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 HTTP/1.1 Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucwzJwIGTsE3cSGbwc0yM_dXyHrCZE3lJKshl297HIXJNMWy8k0GI_Eu5U6EqQfyUsckbTEuanQJUvay9ZpSoXtqyrhaI5dSzOg_9QHzWNqlV-wbBHntm5i-OH9La2rBcmiEJ8ZYmtvWrYI9Bted2oj7y0rvmpApXRpslcz9SflcmKM Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:34:19.758619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2270daf238a640609e9ab514b01d9768", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2270daf238a640609e9ab514b01d9768"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: e9dab30db0a44655828384db53df29f9 Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:34:19.760282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '831291d0-f04d-4927-afcd-88fd058db642'} Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:19.761278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:34:19.762874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:19.765317 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-056c48d8-11ec-4fc8-b576-cf65d08d6bc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Returning 404 to user: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:19.765317 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-056c48d8-11ec-4fc8-b576-cf65d08d6bc2 tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "DELETE /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 404 len: 111 microversion: 2.20 time: 0.030522 Jun 27 15:34:19.765317 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 471/938] 10.222.0.26 () {60 vars in 1279 bytes} [Mon Jun 27 15:34:19 2022] DELETE /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:34:19.768950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea5f6765-54ea-4eb3-b95f-bcd972d39cda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:19.769556 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ea5f6765-54ea-4eb3-b95f-bcd972d39cda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] [instance: 831291d0-f04d-4927-afcd-88fd058db642] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:19.776602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea5f6765-54ea-4eb3-b95f-bcd972d39cda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:19.777043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea5f6765-54ea-4eb3-b95f-bcd972d39cda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:19.777816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea5f6765-54ea-4eb3-b95f-bcd972d39cda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:19.778266 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea5f6765-54ea-4eb3-b95f-bcd972d39cda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:19.794371 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-ea5f6765-54ea-4eb3-b95f-bcd972d39cda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] HTTP exception thrown: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea5f6765-54ea-4eb3-b95f-bcd972d39cda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Request method failure captured: Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 HTTP/1.1 Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucwzJwIGTsE3cSGbwc0yM_dXyHrCZE3lJKshl297HIXJNMWy8k0GI_Eu5U6EqQfyUsckbTEuanQJUvay9ZpSoXtqyrhaI5dSzOg_9QHzWNqlV-wbBHntm5i-OH9La2rBcmiEJ8ZYmtvWrYI9Bted2oj7y0rvmpApXRpslcz9SflcmKM Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:34:19.796871 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_2270daf238a640609e9ab514b01d9768", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/2270daf238a640609e9ab514b01d9768"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/2270daf238a640609e9ab514b01d9768"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 2270daf238a640609e9ab514b01d9768 Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1391181918 Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: e9dab30db0a44655828384db53df29f9 Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1391181918-project Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:34:19.798553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '831291d0-f04d-4927-afcd-88fd058db642'} Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:19.799626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. Jun 27 15:34:19.801169 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:19.802645 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea5f6765-54ea-4eb3-b95f-bcd972d39cda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] Returning 404 to user: Instance 831291d0-f04d-4927-afcd-88fd058db642 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:19.802645 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ea5f6765-54ea-4eb3-b95f-bcd972d39cda tempest-AttachVolumeShelveTestJSON-1391181918 tempest-AttachVolumeShelveTestJSON-1391181918-project] 10.222.0.26 "GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642" status: 404 len: 111 microversion: 2.20 time: 0.033352 Jun 27 15:34:19.802645 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 468/939] 10.222.0.26 () {60 vars in 1276 bytes} [Mon Jun 27 15:34:19 2022] GET /compute/v2.1/servers/831291d0-f04d-4927-afcd-88fd058db642 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:34:24.746895 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-602c8772-3b0b-4e13-905a-b98747dbf948 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Action: 'create', calling method: .version_select at 0x7fb27349d5e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1330651611", "metadata": {"Type": "work"}}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-602c8772-3b0b-4e13-905a-b98747dbf948 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Request method failure captured: Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 122 Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiuc4AmSRG_41iCw5EcfvTSA11EUzvRO3Mfr-68kGHRLkWDYvOWzv6LdHK6zYzmPRMwRsfQBSTxrYTs2dL8ywkGnuJqwWrOeNswxjDbrbrQz6JHTrTEFJmEfLKD4olCNv9mIGvH5gNSxYGyKQ7Yl0EDW583jMHL4yMhNky99O5W52k1wA Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:34:24.773367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_762136334e4c4c1491cf12d328716123", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/762136334e4c4c1491cf12d328716123"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: d2154473d9fe4225ab0cdcaa7e67ea0c Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1330651611", "metadata": {"Type": "work"}}} Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: Jun 27 15:34:24.775046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1330651611', 'metadata': {'Type': 'work'}}}} Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise error Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi '#$%' Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:24.776104 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 15:34:24.777854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 15:34:24.779264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 15:34:24.779264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.779264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-602c8772-3b0b-4e13-905a-b98747dbf948 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:24.779264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-602c8772-3b0b-4e13-905a-b98747dbf948 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.152392 Jun 27 15:34:24.779264 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 472/940] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jun 27 15:34:24 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 154 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:34:24.785800 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a7e22ec3-6828-47f0-8c22-a7bfcce09b6c tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Action: 'create', calling method: .version_select at 0x7fb273682670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1843439757", "metadata": {"Type": "work"}}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a7e22ec3-6828-47f0-8c22-a7bfcce09b6c tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Request method failure captured: Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 120 Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiuc4AmSRG_41iCw5EcfvTSA11EUzvRO3Mfr-68kGHRLkWDYvOWzv6LdHK6zYzmPRMwRsfQBSTxrYTs2dL8ywkGnuJqwWrOeNswxjDbrbrQz6JHTrTEFJmEfLKD4olCNv9mIGvH5gNSxYGyKQ7Yl0EDW583jMHL4yMhNky99O5W52k1wA Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:34:24.789278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_762136334e4c4c1491cf12d328716123", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/762136334e4c4c1491cf12d328716123"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: d2154473d9fe4225ab0cdcaa7e67ea0c Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1843439757", "metadata": {"Type": "work"}}} Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: Jun 27 15:34:24.790893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1843439757', 'metadata': {'Type': 'work'}}}} Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise error Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi '0' Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:24.792026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 15:34:24.793880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 15:34:24.795503 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 15:34:24.795503 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.799303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a7e22ec3-6828-47f0-8c22-a7bfcce09b6c tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:24.800309 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a7e22ec3-6828-47f0-8c22-a7bfcce09b6c tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.018607 Jun 27 15:34:24.801170 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 469/941] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jun 27 15:34:24 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:34:24.810511 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3b1af09a-3899-408c-a556-b2e86d5e904b tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Action: 'create', calling method: .version_select at 0x7fb27348c5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-987546395", "metadata": {"Type": "work"}}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3b1af09a-3899-408c-a556-b2e86d5e904b tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Request method failure captured: Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 118 Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiuc4AmSRG_41iCw5EcfvTSA11EUzvRO3Mfr-68kGHRLkWDYvOWzv6LdHK6zYzmPRMwRsfQBSTxrYTs2dL8ywkGnuJqwWrOeNswxjDbrbrQz6JHTrTEFJmEfLKD4olCNv9mIGvH5gNSxYGyKQ7Yl0EDW583jMHL4yMhNky99O5W52k1wA Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:34:24.813799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_762136334e4c4c1491cf12d328716123", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/762136334e4c4c1491cf12d328716123"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: d2154473d9fe4225ab0cdcaa7e67ea0c Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-987546395", "metadata": {"Type": "work"}}} Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: Jun 27 15:34:24.815159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-987546395', 'metadata': {'Type': 'work'}}}} Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise error Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi '' Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:24.815963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 15:34:24.817350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 15:34:24.819822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 15:34:24.819822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.819822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3b1af09a-3899-408c-a556-b2e86d5e904b tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:24.819822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3b1af09a-3899-408c-a556-b2e86d5e904b tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008965 Jun 27 15:34:24.819822 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 473/942] 10.222.0.26 () {60 vars in 1155 bytes} [Mon Jun 27 15:34:24 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 15:34:24.825390 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f492f0e8-354d-4f30-8246-aef9b9abb43b tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Calling method '.version_select at 0x7fb27370db80>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:24.855650 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-f492f0e8-354d-4f30-8246-aef9b9abb43b tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] HTTP exception thrown: Volume tempest-invalid-825806349 could not be found. Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f492f0e8-354d-4f30-8246-aef9b9abb43b tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Request method failure captured: Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-825806349 HTTP/1.1 Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiuc4AmSRG_41iCw5EcfvTSA11EUzvRO3Mfr-68kGHRLkWDYvOWzv6LdHK6zYzmPRMwRsfQBSTxrYTs2dL8ywkGnuJqwWrOeNswxjDbrbrQz6JHTrTEFJmEfLKD4olCNv9mIGvH5gNSxYGyKQ7Yl0EDW583jMHL4yMhNky99O5W52k1wA Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:34:24.857736 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_762136334e4c4c1491cf12d328716123", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/762136334e4c4c1491cf12d328716123"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: d2154473d9fe4225ab0cdcaa7e67ea0c Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Volume tempest-invalid-825806349 could not be found. Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': 'tempest-invalid-825806349'} Jun 27 15:34:24.859411 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-825806349 could not be found. (HTTP 404) (Request-ID: req-23441283-8fbb-49c6-966c-94aadb9b1ff9) Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.860510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:34:24.861689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-825806349 could not be found. Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:24.862797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-825806349 could not be found. Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-825806349 could not be found. Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f492f0e8-354d-4f30-8246-aef9b9abb43b tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Returning 404 to user: Volume tempest-invalid-825806349 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f492f0e8-354d-4f30-8246-aef9b9abb43b tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-825806349" status: 404 len: 98 microversion: 2.1 time: 0.037748 Jun 27 15:34:24.864189 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 470/943] 10.222.0.26 () {58 vars in 1214 bytes} [Mon Jun 27 15:34:24 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-825806349 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 27 15:34:24.870854 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f161bb82-68ca-4934-aff0-1cbf4a8f0330 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004133 Jun 27 15:34:24.871374 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 474/944] 10.222.0.26 () {58 vars in 1139 bytes} [Mon Jun 27 15:34:24 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 15:34:24.881238 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-50a7f4ce-486b-47ca-982a-f846ee51866e tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004119 Jun 27 15:34:24.881724 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 471/945] 10.222.0.26 () {58 vars in 1136 bytes} [Mon Jun 27 15:34:24 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 15:34:24.890744 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c9d747ce-2e36-4388-9ff2-6d579bd423e4 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Calling method '.version_select at 0x7fb27349d790>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:24.922304 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-c9d747ce-2e36-4388-9ff2-6d579bd423e4 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] HTTP exception thrown: Volume 9336c523-69ec-44fb-98bb-233bc538c902 could not be found. Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c9d747ce-2e36-4388-9ff2-6d579bd423e4 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Request method failure captured: Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: DELETE /compute/v2.1/os-volumes/9336c523-69ec-44fb-98bb-233bc538c902 HTTP/1.1 Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiuc4AmSRG_41iCw5EcfvTSA11EUzvRO3Mfr-68kGHRLkWDYvOWzv6LdHK6zYzmPRMwRsfQBSTxrYTs2dL8ywkGnuJqwWrOeNswxjDbrbrQz6JHTrTEFJmEfLKD4olCNv9mIGvH5gNSxYGyKQ7Yl0EDW583jMHL4yMhNky99O5W52k1wA Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:34:24.924352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_762136334e4c4c1491cf12d328716123", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/762136334e4c4c1491cf12d328716123"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: d2154473d9fe4225ab0cdcaa7e67ea0c Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Volume 9336c523-69ec-44fb-98bb-233bc538c902 could not be found. Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '9336c523-69ec-44fb-98bb-233bc538c902'} Jun 27 15:34:24.925886 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9336c523-69ec-44fb-98bb-233bc538c902 could not be found. (HTTP 404) (Request-ID: req-2d4a4e58-c820-4e39-b32c-f99a0da5bfbe) Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.927012 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 15:34:24.928378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9336c523-69ec-44fb-98bb-233bc538c902 could not be found. Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 15:34:24.929641 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9336c523-69ec-44fb-98bb-233bc538c902 could not be found. Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9336c523-69ec-44fb-98bb-233bc538c902 could not be found. Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c9d747ce-2e36-4388-9ff2-6d579bd423e4 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Returning 404 to user: Volume 9336c523-69ec-44fb-98bb-233bc538c902 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c9d747ce-2e36-4388-9ff2-6d579bd423e4 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/9336c523-69ec-44fb-98bb-233bc538c902" status: 404 len: 109 microversion: 2.1 time: 0.039019 Jun 27 15:34:24.930845 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 475/946] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jun 27 15:34:24 2022] DELETE /compute/v2.1/os-volumes/9336c523-69ec-44fb-98bb-233bc538c902 => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:34:24.937604 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1a415ae1-050c-4d81-bfd4-4555df820581 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Calling method '.version_select at 0x7fb2736a51f0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:24.965848 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-1a415ae1-050c-4d81-bfd4-4555df820581 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] HTTP exception thrown: Volume acd3e84f-0cd2-472b-a16a-8d18165ee635 could not be found. Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1a415ae1-050c-4d81-bfd4-4555df820581 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Request method failure captured: Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/os-volumes/acd3e84f-0cd2-472b-a16a-8d18165ee635 HTTP/1.1 Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiuc4AmSRG_41iCw5EcfvTSA11EUzvRO3Mfr-68kGHRLkWDYvOWzv6LdHK6zYzmPRMwRsfQBSTxrYTs2dL8ywkGnuJqwWrOeNswxjDbrbrQz6JHTrTEFJmEfLKD4olCNv9mIGvH5gNSxYGyKQ7Yl0EDW583jMHL4yMhNky99O5W52k1wA Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:34:24.967938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_762136334e4c4c1491cf12d328716123", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/762136334e4c4c1491cf12d328716123"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/762136334e4c4c1491cf12d328716123"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 762136334e4c4c1491cf12d328716123 Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-VolumesNegativeTest-1564847591 Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: d2154473d9fe4225ab0cdcaa7e67ea0c Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-VolumesNegativeTest-1564847591-project Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Volume acd3e84f-0cd2-472b-a16a-8d18165ee635 could not be found. Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': 'acd3e84f-0cd2-472b-a16a-8d18165ee635'} Jun 27 15:34:24.969620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume acd3e84f-0cd2-472b-a16a-8d18165ee635 could not be found. (HTTP 404) (Request-ID: req-42df66fc-1a0a-4403-b4e6-d602cfb6fbee) Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.970589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 15:34:24.972012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume acd3e84f-0cd2-472b-a16a-8d18165ee635 could not be found. Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 15:34:24.974838 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume acd3e84f-0cd2-472b-a16a-8d18165ee635 could not be found. Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume acd3e84f-0cd2-472b-a16a-8d18165ee635 could not be found. Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1a415ae1-050c-4d81-bfd4-4555df820581 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] Returning 404 to user: Volume acd3e84f-0cd2-472b-a16a-8d18165ee635 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1a415ae1-050c-4d81-bfd4-4555df820581 tempest-VolumesNegativeTest-1564847591 tempest-VolumesNegativeTest-1564847591-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/acd3e84f-0cd2-472b-a16a-8d18165ee635" status: 404 len: 109 microversion: 2.1 time: 0.035923 Jun 27 15:34:24.976364 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 472/947] 10.222.0.26 () {58 vars in 1244 bytes} [Mon Jun 27 15:34:24 2022] GET /compute/v2.1/os-volumes/acd3e84f-0cd2-472b-a16a-8d18165ee635 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:34:33.328473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5fb597a6-bfec-4ad0-8bd0-8ed27efe1f7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:33.329116 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5fb597a6-bfec-4ad0-8bd0-8ed27efe1f7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:33.332792 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:33.334117 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=25 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:33.343858 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5fb597a6-bfec-4ad0-8bd0-8ed27efe1f7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:33.344339 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5fb597a6-bfec-4ad0-8bd0-8ed27efe1f7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:33.345469 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5fb597a6-bfec-4ad0-8bd0-8ed27efe1f7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:33.345626 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5fb597a6-bfec-4ad0-8bd0-8ed27efe1f7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:33.371749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5fb597a6-bfec-4ad0-8bd0-8ed27efe1f7a tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/ips" status: 200 len: 148 microversion: 2.1 time: 0.047945 Jun 27 15:34:33.372266 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 476/948] 10.222.0.26 () {58 vars in 1247 bytes} [Mon Jun 27 15:34:33 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/ips => generated 148 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:34:34.710790 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:34.712721 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=16 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:34:34.716885 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c0dc3298-250e-4e2e-8cbe-6b5c586bb9a0 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a26858a7-ff61-4196-a4d0-fa2733bb8b4f"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:34:34.717951 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c0dc3298-250e-4e2e-8cbe-6b5c586bb9a0 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:34.725278 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0dc3298-250e-4e2e-8cbe-6b5c586bb9a0 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:34.725730 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0dc3298-250e-4e2e-8cbe-6b5c586bb9a0 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:34.726511 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0dc3298-250e-4e2e-8cbe-6b5c586bb9a0 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:34.726950 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c0dc3298-250e-4e2e-8cbe-6b5c586bb9a0 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:34.983230 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c0dc3298-250e-4e2e-8cbe-6b5c586bb9a0 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "POST /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.273329 Jun 27 15:34:34.983952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 473/949] 10.222.0.26 () {60 vars in 1322 bytes} [Mon Jun 27 15:34:34 2022] POST /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/os-volume_attachments => generated 194 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:34:41.631794 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8bd00cf4-f5fd-472e-bc8c-994fd92d0309 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:41.632482 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8bd00cf4-f5fd-472e-bc8c-994fd92d0309 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:41.640359 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8bd00cf4-f5fd-472e-bc8c-994fd92d0309 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:41.640840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8bd00cf4-f5fd-472e-bc8c-994fd92d0309 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:41.641595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8bd00cf4-f5fd-472e-bc8c-994fd92d0309 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:41.642021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8bd00cf4-f5fd-472e-bc8c-994fd92d0309 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:41.740554 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-8bd00cf4-f5fd-472e-bc8c-994fd92d0309 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lazy-loading 'services' on Instance uuid 4010529e-f303-42fc-a783-e7983c3d43ed {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:34:41.822240 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8bd00cf4-f5fd-472e-bc8c-994fd92d0309 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/os-volume_attachments/a26858a7-ff61-4196-a4d0-fa2733bb8b4f" status: 202 len: 0 microversion: 2.1 time: 0.194312 Jun 27 15:34:41.822833 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 477/950] 10.222.0.26 () {58 vars in 1415 bytes} [Mon Jun 27 15:34:41 2022] DELETE /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/os-volume_attachments/a26858a7-ff61-4196-a4d0-fa2733bb8b4f => generated 0 bytes in 196 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:34:41.833348 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dd93c873-dfb6-4737-ac68-48ae0c9ba101 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:41.835082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dd93c873-dfb6-4737-ac68-48ae0c9ba101 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:41.843854 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd93c873-dfb6-4737-ac68-48ae0c9ba101 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:41.844499 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd93c873-dfb6-4737-ac68-48ae0c9ba101 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:41.845614 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd93c873-dfb6-4737-ac68-48ae0c9ba101 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:41.846160 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd93c873-dfb6-4737-ac68-48ae0c9ba101 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:41.884011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dd93c873-dfb6-4737-ac68-48ae0c9ba101 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055635 Jun 27 15:34:41.884711 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 474/951] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:34:41 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:34:42.897760 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c3322e32-0b4a-4ebc-af24-09d0b9472b67 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:42.899691 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-c3322e32-0b4a-4ebc-af24-09d0b9472b67 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:42.907895 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c3322e32-0b4a-4ebc-af24-09d0b9472b67 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:42.908726 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c3322e32-0b4a-4ebc-af24-09d0b9472b67 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:42.909504 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c3322e32-0b4a-4ebc-af24-09d0b9472b67 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:42.909943 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c3322e32-0b4a-4ebc-af24-09d0b9472b67 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:42.942824 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c3322e32-0b4a-4ebc-af24-09d0b9472b67 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050440 Jun 27 15:34:42.943875 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 478/952] 10.222.0.26 () {58 vars in 1301 bytes} [Mon Jun 27 15:34:42 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 15:34:43.113798 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-eddfbddb-ff26-4bd4-95da-0cdf700b3d9b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:43.114556 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-eddfbddb-ff26-4bd4-95da-0cdf700b3d9b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:43.122043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eddfbddb-ff26-4bd4-95da-0cdf700b3d9b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:43.122811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eddfbddb-ff26-4bd4-95da-0cdf700b3d9b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:43.123545 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eddfbddb-ff26-4bd4-95da-0cdf700b3d9b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:43.124079 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eddfbddb-ff26-4bd4-95da-0cdf700b3d9b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:43.154005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-eddfbddb-ff26-4bd4-95da-0cdf700b3d9b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:34:43.278507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-eddfbddb-ff26-4bd4-95da-0cdf700b3d9b tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 204 len: 0 microversion: 2.1 time: 0.167874 Jun 27 15:34:43.280585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 475/953] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:34:43 2022] DELETE /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:34:43.298060 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4c682fc2-94a3-45e1-bac7-bbd28d277b09 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:43.299110 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4c682fc2-94a3-45e1-bac7-bbd28d277b09 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:43.309647 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4c682fc2-94a3-45e1-bac7-bbd28d277b09 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:43.310347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4c682fc2-94a3-45e1-bac7-bbd28d277b09 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:43.312926 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4c682fc2-94a3-45e1-bac7-bbd28d277b09 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:43.313587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4c682fc2-94a3-45e1-bac7-bbd28d277b09 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:43.522287 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4c682fc2-94a3-45e1-bac7-bbd28d277b09 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:43.531961 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4c682fc2-94a3-45e1-bac7-bbd28d277b09 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1681 microversion: 2.1 time: 0.241315 Jun 27 15:34:43.533288 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 479/954] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:43 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1681 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:34:44.550632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ff4f42a7-f1f3-4126-9d59-a4d8134c8e3c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:44.551338 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ff4f42a7-f1f3-4126-9d59-a4d8134c8e3c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:44.559879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff4f42a7-f1f3-4126-9d59-a4d8134c8e3c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:44.560356 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff4f42a7-f1f3-4126-9d59-a4d8134c8e3c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:44.561148 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff4f42a7-f1f3-4126-9d59-a4d8134c8e3c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:44.561608 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ff4f42a7-f1f3-4126-9d59-a4d8134c8e3c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:44.741082 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ff4f42a7-f1f3-4126-9d59-a4d8134c8e3c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:44.749811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ff4f42a7-f1f3-4126-9d59-a4d8134c8e3c tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1681 microversion: 2.1 time: 0.203603 Jun 27 15:34:44.750391 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 476/955] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:44 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1681 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:34:45.769212 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-006413e2-82cc-4b5c-8f92-65461adf77fe tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:45.769781 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-006413e2-82cc-4b5c-8f92-65461adf77fe tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:45.777321 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-006413e2-82cc-4b5c-8f92-65461adf77fe tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:45.777776 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-006413e2-82cc-4b5c-8f92-65461adf77fe tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:45.778582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-006413e2-82cc-4b5c-8f92-65461adf77fe tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:45.779132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-006413e2-82cc-4b5c-8f92-65461adf77fe tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:45.791336 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-164c45c2-1ade-47d8-9f1f-cb39d0b03b25 req-f03b2dd6-17a1-4309-b8ca-32973852777d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4010529e-f303-42fc-a783-e7983c3d43ed", "name": "network-vif-deleted", "tag": "a86d0d76-5450-4083-8558-738baa5dd07f"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:34:45.806004 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-164c45c2-1ade-47d8-9f1f-cb39d0b03b25 req-f03b2dd6-17a1-4309-b8ca-32973852777d service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:45.806448 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-164c45c2-1ade-47d8-9f1f-cb39d0b03b25 req-f03b2dd6-17a1-4309-b8ca-32973852777d service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:45.834969 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-164c45c2-1ade-47d8-9f1f-cb39d0b03b25 req-f03b2dd6-17a1-4309-b8ca-32973852777d service nova] Creating event network-vif-deleted:a86d0d76-5450-4083-8558-738baa5dd07f for instance 4010529e-f303-42fc-a783-e7983c3d43ed on hv-cinder-84779 Jun 27 15:34:45.848743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-164c45c2-1ade-47d8-9f1f-cb39d0b03b25 req-f03b2dd6-17a1-4309-b8ca-32973852777d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061361 Jun 27 15:34:45.851471 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 477/956] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:34:45.900638 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-006413e2-82cc-4b5c-8f92-65461adf77fe tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23abc809ab644c1da0270a35ac8bab21', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dff1983b1b3047378b88d87d54aa709d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:45.909388 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-006413e2-82cc-4b5c-8f92-65461adf77fe tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 200 len: 1613 microversion: 2.1 time: 0.144618 Jun 27 15:34:45.919748 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 480/957] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:45 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 1613 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:34:46.930404 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-56fa5101-894b-42a2-bf50-cc908d9cc0c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:46.931021 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-56fa5101-894b-42a2-bf50-cc908d9cc0c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:46.938704 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56fa5101-894b-42a2-bf50-cc908d9cc0c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:46.939117 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56fa5101-894b-42a2-bf50-cc908d9cc0c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:46.940048 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56fa5101-894b-42a2-bf50-cc908d9cc0c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:46.940595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56fa5101-894b-42a2-bf50-cc908d9cc0c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:46.955539 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-56fa5101-894b-42a2-bf50-cc908d9cc0c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-56fa5101-894b-42a2-bf50-cc908d9cc0c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed HTTP/1.1 Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:34:46.957291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:46.958862 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '4010529e-f303-42fc-a783-e7983c3d43ed'} Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:46.959687 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:46.961263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:46.963157 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-56fa5101-894b-42a2-bf50-cc908d9cc0c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:46.963157 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-56fa5101-894b-42a2-bf50-cc908d9cc0c6 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 404 len: 111 microversion: 2.1 time: 0.034819 Jun 27 15:34:46.963157 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 478/958] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:46 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:34:46.971656 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f04c550d-bec1-4207-a379-9036479878c5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '.version_select at 0x7fb27348c160>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:47.001213 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f04c550d-bec1-4207-a379-9036479878c5 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034885159" status: 202 len: 0 microversion: 2.1 time: 0.036133 Jun 27 15:34:47.002236 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 481/959] 10.222.0.26 () {58 vars in 1220 bytes} [Mon Jun 27 15:34:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1034885159 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:34:48.906705 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a50cb672-6ebc-44a5-a6b1-2294cc12c554 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:48.907223 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a50cb672-6ebc-44a5-a6b1-2294cc12c554 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:48.914188 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a50cb672-6ebc-44a5-a6b1-2294cc12c554 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:48.914659 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a50cb672-6ebc-44a5-a6b1-2294cc12c554 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:48.915442 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a50cb672-6ebc-44a5-a6b1-2294cc12c554 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:48.915876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a50cb672-6ebc-44a5-a6b1-2294cc12c554 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:48.930433 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-a50cb672-6ebc-44a5-a6b1-2294cc12c554 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a50cb672-6ebc-44a5-a6b1-2294cc12c554 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed HTTP/1.1 Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:34:48.932000 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:48.933936 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '4010529e-f303-42fc-a783-e7983c3d43ed'} Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:48.934821 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:48.936217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:48.937880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a50cb672-6ebc-44a5-a6b1-2294cc12c554 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:48.937880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a50cb672-6ebc-44a5-a6b1-2294cc12c554 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 404 len: 111 microversion: 2.1 time: 0.031039 Jun 27 15:34:48.937880 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 479/960] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:34:48 2022] DELETE /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:34:48.945143 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-47617370-d7f2-452a-a6a4-eebf74004527 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:48.945768 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-47617370-d7f2-452a-a6a4-eebf74004527 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 4010529e-f303-42fc-a783-e7983c3d43ed] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:48.953281 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-47617370-d7f2-452a-a6a4-eebf74004527 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:48.953788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-47617370-d7f2-452a-a6a4-eebf74004527 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:48.954723 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-47617370-d7f2-452a-a6a4-eebf74004527 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:48.955282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-47617370-d7f2-452a-a6a4-eebf74004527 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:48.971517 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-47617370-d7f2-452a-a6a4-eebf74004527 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-47617370-d7f2-452a-a6a4-eebf74004527 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed HTTP/1.1 Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:34:48.973569 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:48.975272 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '4010529e-f303-42fc-a783-e7983c3d43ed'} Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:48.976518 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. Jun 27 15:34:48.978034 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:48.979355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-47617370-d7f2-452a-a6a4-eebf74004527 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance 4010529e-f303-42fc-a783-e7983c3d43ed could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:48.979355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-47617370-d7f2-452a-a6a4-eebf74004527 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed" status: 404 len: 111 microversion: 2.1 time: 0.035612 Jun 27 15:34:48.979355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 482/961] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:48 2022] GET /compute/v2.1/servers/4010529e-f303-42fc-a783-e7983c3d43ed => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:34:50.129664 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0c4f0415-abbc-4975-a018-5f40935a3234 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:50.130203 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0c4f0415-abbc-4975-a018-5f40935a3234 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:50.137988 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c4f0415-abbc-4975-a018-5f40935a3234 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:50.138220 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c4f0415-abbc-4975-a018-5f40935a3234 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:50.138886 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c4f0415-abbc-4975-a018-5f40935a3234 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:50.139318 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0c4f0415-abbc-4975-a018-5f40935a3234 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:50.154825 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-0c4f0415-abbc-4975-a018-5f40935a3234 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0c4f0415-abbc-4975-a018-5f40935a3234 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda HTTP/1.1 Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:34:50.156500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:34:50.158142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': 'a3afef28-40eb-48c6-a65c-f549cc963cda'} Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:50.159243 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:34:50.160826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.162603 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0c4f0415-abbc-4975-a018-5f40935a3234 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:50.162603 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0c4f0415-abbc-4975-a018-5f40935a3234 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 404 len: 111 microversion: 2.1 time: 0.032274 Jun 27 15:34:50.162603 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 480/962] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:34:50 2022] DELETE /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:34:50.169150 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-97a737ef-3f56-42ef-a2a8-bd223bc50c32 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:50.169774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-97a737ef-3f56-42ef-a2a8-bd223bc50c32 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: a3afef28-40eb-48c6-a65c-f549cc963cda] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:50.176921 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-97a737ef-3f56-42ef-a2a8-bd223bc50c32 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:50.177373 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-97a737ef-3f56-42ef-a2a8-bd223bc50c32 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:50.178248 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-97a737ef-3f56-42ef-a2a8-bd223bc50c32 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:50.178872 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-97a737ef-3f56-42ef-a2a8-bd223bc50c32 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:50.199516 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-97a737ef-3f56-42ef-a2a8-bd223bc50c32 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-97a737ef-3f56-42ef-a2a8-bd223bc50c32 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda HTTP/1.1 Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:34:50.201207 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:34:50.204431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'a3afef28-40eb-48c6-a65c-f549cc963cda'} Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:50.206473 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. Jun 27 15:34:50.209183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.212414 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-97a737ef-3f56-42ef-a2a8-bd223bc50c32 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance a3afef28-40eb-48c6-a65c-f549cc963cda could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:50.212414 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-97a737ef-3f56-42ef-a2a8-bd223bc50c32 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda" status: 404 len: 111 microversion: 2.1 time: 0.037457 Jun 27 15:34:50.212414 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 483/963] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:50 2022] GET /compute/v2.1/servers/a3afef28-40eb-48c6-a65c-f549cc963cda => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:34:50.212660 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9fa39aa6-91c2-41e0-951f-c2557ad66e8e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:50.212996 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9fa39aa6-91c2-41e0-951f-c2557ad66e8e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:50.219304 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fa39aa6-91c2-41e0-951f-c2557ad66e8e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:50.219753 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fa39aa6-91c2-41e0-951f-c2557ad66e8e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:50.220608 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fa39aa6-91c2-41e0-951f-c2557ad66e8e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:50.221043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9fa39aa6-91c2-41e0-951f-c2557ad66e8e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:50.237118 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-9fa39aa6-91c2-41e0-951f-c2557ad66e8e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9fa39aa6-91c2-41e0-951f-c2557ad66e8e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 HTTP/1.1 Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:34:50.238716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:34:50.240256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': 'b669df6d-2c11-4910-bdc8-0eb82915b879'} Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:50.241732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:34:50.243241 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.245469 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9fa39aa6-91c2-41e0-951f-c2557ad66e8e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:50.245469 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9fa39aa6-91c2-41e0-951f-c2557ad66e8e tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 404 len: 111 microversion: 2.1 time: 0.032361 Jun 27 15:34:50.245469 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 481/964] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:34:50 2022] DELETE /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:34:50.248967 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-72e9d0ae-edf0-4ad5-afc3-70b49bf1d774 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:50.249572 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-72e9d0ae-edf0-4ad5-afc3-70b49bf1d774 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: b669df6d-2c11-4910-bdc8-0eb82915b879] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:50.255862 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-72e9d0ae-edf0-4ad5-afc3-70b49bf1d774 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:50.256772 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-72e9d0ae-edf0-4ad5-afc3-70b49bf1d774 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:50.257482 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-72e9d0ae-edf0-4ad5-afc3-70b49bf1d774 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:50.257897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-72e9d0ae-edf0-4ad5-afc3-70b49bf1d774 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:50.273511 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-72e9d0ae-edf0-4ad5-afc3-70b49bf1d774 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-72e9d0ae-edf0-4ad5-afc3-70b49bf1d774 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 HTTP/1.1 Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:34:50.275217 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:34:50.276878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'b669df6d-2c11-4910-bdc8-0eb82915b879'} Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:50.277734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. Jun 27 15:34:50.279237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:50.280915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-72e9d0ae-edf0-4ad5-afc3-70b49bf1d774 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance b669df6d-2c11-4910-bdc8-0eb82915b879 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:50.280915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-72e9d0ae-edf0-4ad5-afc3-70b49bf1d774 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879" status: 404 len: 111 microversion: 2.1 time: 0.031544 Jun 27 15:34:50.280915 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 484/965] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:50 2022] GET /compute/v2.1/servers/b669df6d-2c11-4910-bdc8-0eb82915b879 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 15:34:51.445413 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5a22abf2-d521-4311-a4f0-a75f58224e52 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:51.445914 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5a22abf2-d521-4311-a4f0-a75f58224e52 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:51.453045 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5a22abf2-d521-4311-a4f0-a75f58224e52 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:51.453499 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5a22abf2-d521-4311-a4f0-a75f58224e52 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:51.454263 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5a22abf2-d521-4311-a4f0-a75f58224e52 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:51.454694 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5a22abf2-d521-4311-a4f0-a75f58224e52 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:51.468443 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-5a22abf2-d521-4311-a4f0-a75f58224e52 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5a22abf2-d521-4311-a4f0-a75f58224e52 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 HTTP/1.1 Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:34:51.469986 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:34:51.471507 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '598844cf-f73b-4630-ad12-f08ab67e89e3'} Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:51.472445 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:34:51.474086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:34:51.476176 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5a22abf2-d521-4311-a4f0-a75f58224e52 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:51.476176 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5a22abf2-d521-4311-a4f0-a75f58224e52 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "DELETE /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 404 len: 111 microversion: 2.1 time: 0.031277 Jun 27 15:34:51.476176 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 482/966] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:34:51 2022] DELETE /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:34:51.480404 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-51b8098b-7aa1-42f9-a60b-78bac3218c82 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:51.481035 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-51b8098b-7aa1-42f9-a60b-78bac3218c82 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] [instance: 598844cf-f73b-4630-ad12-f08ab67e89e3] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:51.487670 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-51b8098b-7aa1-42f9-a60b-78bac3218c82 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:51.488128 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-51b8098b-7aa1-42f9-a60b-78bac3218c82 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:51.488973 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-51b8098b-7aa1-42f9-a60b-78bac3218c82 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:51.489394 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-51b8098b-7aa1-42f9-a60b-78bac3218c82 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:51.503519 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-51b8098b-7aa1-42f9-a60b-78bac3218c82 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] HTTP exception thrown: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-51b8098b-7aa1-42f9-a60b-78bac3218c82 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Request method failure captured: Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 HTTP/1.1 Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiucyPx-0ocGNjoW4IGi-fwwOhxjQY638S-FEf0a5vvl3_v8fLJF4b8wAkW83Ax8Nuqgt7RdjHU7t6WYgCRnVZ3HCSEyRFhArnTWZ8lEBFiA1h7WPwbJmrswXculsTwZbWbyPb5F2w9RxO1bEZRCVXEbG5gz6jZlbDqwJprDS7RT5Vc_Q Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:34:51.505086 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_dff1983b1b3047378b88d87d54aa709d", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/dff1983b1b3047378b88d87d54aa709d"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: dff1983b1b3047378b88d87d54aa709d Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-51346385 Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 23abc809ab644c1da0270a35ac8bab21 Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-AttachVolumeNegativeTest-51346385-project Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:34:51.507788 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': '598844cf-f73b-4630-ad12-f08ab67e89e3'} Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:34:51.509277 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. Jun 27 15:34:51.511673 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:34:51.515094 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-51b8098b-7aa1-42f9-a60b-78bac3218c82 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] Returning 404 to user: Instance 598844cf-f73b-4630-ad12-f08ab67e89e3 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:34:51.515094 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-51b8098b-7aa1-42f9-a60b-78bac3218c82 tempest-AttachVolumeNegativeTest-51346385 tempest-AttachVolumeNegativeTest-51346385-project] 10.222.0.26 "GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3" status: 404 len: 111 microversion: 2.1 time: 0.030018 Jun 27 15:34:51.515094 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 485/967] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:51 2022] GET /compute/v2.1/servers/598844cf-f73b-4630-ad12-f08ab67e89e3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:34:56.280546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:34:56.281035 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Mon Jun 27 15:34:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:34:57.126247 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-2059320691", "imageRef": "c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0", "flavorRef": "452"}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:34:57.221934 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] validate_networks() for None {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:34:57.906005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:34:57.907440 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:34:57.907440 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:34:57.907440 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:34:57.907771 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:34:57.918811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:57.919250 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:57.920388 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:57.920992 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:57.949315 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Getting quotas for project 7ef1f8afa02043918b4e76f9af38d47f. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:34:57.955826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Getting quotas for user 3b100ef05c594d18b3868c2d0cb4f175 and project 7ef1f8afa02043918b4e76f9af38d47f. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:34:57.972990 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:34:57.976574 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c2c76a48-7ab6-4c0a-8956-5a3b6d45ded0',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:34:58.039615 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1d47e2bb-f6b3-4012-8ed3-7104a496783c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.917271 Jun 27 15:34:58.045904 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 483/968] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 920 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:34:58.053187 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-54798295-3f9a-4d9a-b2cc-c76c820edd71 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:58.058889 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-54798295-3f9a-4d9a-b2cc-c76c820edd71 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:58.137539 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-54798295-3f9a-4d9a-b2cc-c76c820edd71 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:58.145480 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-54798295-3f9a-4d9a-b2cc-c76c820edd71 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1215 microversion: 2.1 time: 0.097037 Jun 27 15:34:58.146513 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 486/969] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:58 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1215 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:34:59.164256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fb7dcb29-4242-48fb-a47e-294cb76ebf34 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:34:59.165618 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fb7dcb29-4242-48fb-a47e-294cb76ebf34 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:34:59.173236 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb7dcb29-4242-48fb-a47e-294cb76ebf34 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:59.173236 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb7dcb29-4242-48fb-a47e-294cb76ebf34 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:59.174091 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb7dcb29-4242-48fb-a47e-294cb76ebf34 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:34:59.174641 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fb7dcb29-4242-48fb-a47e-294cb76ebf34 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:34:59.284098 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fb7dcb29-4242-48fb-a47e-294cb76ebf34 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:34:59.293459 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fb7dcb29-4242-48fb-a47e-294cb76ebf34 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1219 microversion: 2.1 time: 0.134012 Jun 27 15:34:59.294122 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 484/970] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:34:59 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1219 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:00.311260 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5ba42580-02b2-454e-9ead-056e1c5a5aaa tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:00.311995 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5ba42580-02b2-454e-9ead-056e1c5a5aaa tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:00.321094 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5ba42580-02b2-454e-9ead-056e1c5a5aaa tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:00.321094 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5ba42580-02b2-454e-9ead-056e1c5a5aaa tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:00.322882 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5ba42580-02b2-454e-9ead-056e1c5a5aaa tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:00.322882 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5ba42580-02b2-454e-9ead-056e1c5a5aaa tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:00.404032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5ba42580-02b2-454e-9ead-056e1c5a5aaa tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:00.413403 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5ba42580-02b2-454e-9ead-056e1c5a5aaa tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1211 microversion: 2.1 time: 0.106247 Jun 27 15:35:00.414051 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 487/971] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:00 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1211 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:01.439337 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9ef522c8-6b9c-44c7-b37e-d1dd111f31bd tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:01.440943 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9ef522c8-6b9c-44c7-b37e-d1dd111f31bd tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:01.455604 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9ef522c8-6b9c-44c7-b37e-d1dd111f31bd tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:01.457610 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9ef522c8-6b9c-44c7-b37e-d1dd111f31bd tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:01.459857 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9ef522c8-6b9c-44c7-b37e-d1dd111f31bd tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:01.460840 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9ef522c8-6b9c-44c7-b37e-d1dd111f31bd tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:01.553140 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-9ef522c8-6b9c-44c7-b37e-d1dd111f31bd tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:01.563253 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9ef522c8-6b9c-44c7-b37e-d1dd111f31bd tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1275 microversion: 2.1 time: 0.134314 Jun 27 15:35:01.563979 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 485/972] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:01 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1275 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:02.590006 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a0ef3076-e5be-4741-8f61-ac56b99984f6 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:02.590993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a0ef3076-e5be-4741-8f61-ac56b99984f6 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:02.621906 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a0ef3076-e5be-4741-8f61-ac56b99984f6 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:02.622894 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a0ef3076-e5be-4741-8f61-ac56b99984f6 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:02.624464 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a0ef3076-e5be-4741-8f61-ac56b99984f6 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:02.625250 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a0ef3076-e5be-4741-8f61-ac56b99984f6 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:03.026680 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a0ef3076-e5be-4741-8f61-ac56b99984f6 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:03.049418 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a0ef3076-e5be-4741-8f61-ac56b99984f6 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1315 microversion: 2.1 time: 0.463846 Jun 27 15:35:03.050590 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 488/973] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:02 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:03.591809 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-de69e08a-65e4-4e66-a888-a673dbf415e4 req-8798b99a-2812-4a12-9fd5-0e83dfe0c164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ae09253b-ad6f-4d97-974f-ab73fe47e883", "tag": "48d76af5-e9ed-47d1-8aac-d9f2968f698e"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:35:03.606832 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-de69e08a-65e4-4e66-a888-a673dbf415e4 req-8798b99a-2812-4a12-9fd5-0e83dfe0c164 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:03.607698 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-de69e08a-65e4-4e66-a888-a673dbf415e4 req-8798b99a-2812-4a12-9fd5-0e83dfe0c164 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:03.639112 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-de69e08a-65e4-4e66-a888-a673dbf415e4 req-8798b99a-2812-4a12-9fd5-0e83dfe0c164 service nova] Creating event network-changed:48d76af5-e9ed-47d1-8aac-d9f2968f698e for instance ae09253b-ad6f-4d97-974f-ab73fe47e883 on hv-cinder-84779 Jun 27 15:35:03.648237 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-de69e08a-65e4-4e66-a888-a673dbf415e4 req-8798b99a-2812-4a12-9fd5-0e83dfe0c164 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061140 Jun 27 15:35:03.649423 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 486/974] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:35:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:35:04.067511 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-0e2c5809-17e7-4eae-9eb9-6423119b719b tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:04.068135 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-0e2c5809-17e7-4eae-9eb9-6423119b719b tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:04.070962 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=30,nova_api:DELETE=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:04.080100 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0e2c5809-17e7-4eae-9eb9-6423119b719b tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:04.080698 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0e2c5809-17e7-4eae-9eb9-6423119b719b tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:04.081679 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0e2c5809-17e7-4eae-9eb9-6423119b719b tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:04.082224 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0e2c5809-17e7-4eae-9eb9-6423119b719b tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:04.090500 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=52,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:04.266604 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-0e2c5809-17e7-4eae-9eb9-6423119b719b tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:04.282279 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-0e2c5809-17e7-4eae-9eb9-6423119b719b tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1315 microversion: 2.1 time: 0.217840 Jun 27 15:35:04.282987 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 489/975] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:04 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1315 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:35:05.304398 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-51fb70fa-46a0-4a48-b07d-ee7c8b58e58f tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:05.306788 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-51fb70fa-46a0-4a48-b07d-ee7c8b58e58f tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:05.309875 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:05.319537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-51fb70fa-46a0-4a48-b07d-ee7c8b58e58f tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:05.320026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-51fb70fa-46a0-4a48-b07d-ee7c8b58e58f tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:05.321308 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-51fb70fa-46a0-4a48-b07d-ee7c8b58e58f tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:05.321757 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-51fb70fa-46a0-4a48-b07d-ee7c8b58e58f tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:05.327137 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:05.493432 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-51fb70fa-46a0-4a48-b07d-ee7c8b58e58f tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:05.501593 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-51fb70fa-46a0-4a48-b07d-ee7c8b58e58f tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1315 microversion: 2.1 time: 0.204335 Jun 27 15:35:05.502224 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 487/976] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:05 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1315 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:06.519558 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-cde02520-1133-4600-be85-59cb93fa8e67 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:06.520225 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-cde02520-1133-4600-be85-59cb93fa8e67 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:06.528490 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cde02520-1133-4600-be85-59cb93fa8e67 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:06.529063 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cde02520-1133-4600-be85-59cb93fa8e67 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:06.529647 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cde02520-1133-4600-be85-59cb93fa8e67 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:06.530090 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-cde02520-1133-4600-be85-59cb93fa8e67 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:06.710428 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-cde02520-1133-4600-be85-59cb93fa8e67 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:06.729656 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-cde02520-1133-4600-be85-59cb93fa8e67 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1315 microversion: 2.1 time: 0.213950 Jun 27 15:35:06.730265 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 490/977] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:06 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:07.749128 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fa3f17e5-cb1d-4c25-8ba8-fc597383d57c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:07.750525 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fa3f17e5-cb1d-4c25-8ba8-fc597383d57c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:07.758575 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fa3f17e5-cb1d-4c25-8ba8-fc597383d57c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:07.759090 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fa3f17e5-cb1d-4c25-8ba8-fc597383d57c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:07.760245 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fa3f17e5-cb1d-4c25-8ba8-fc597383d57c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:07.760707 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fa3f17e5-cb1d-4c25-8ba8-fc597383d57c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:07.930690 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:07.948755 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fa3f17e5-cb1d-4c25-8ba8-fc597383d57c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:07.963673 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fa3f17e5-cb1d-4c25-8ba8-fc597383d57c tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1315 microversion: 2.1 time: 0.220004 Jun 27 15:35:07.964861 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 488/978] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:07 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:08.092347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-e9ad97bd-789d-4865-875b-c56a7732c98a req-9ee0340f-e3bb-48b0-ad45-6a20fcc3e404 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae09253b-ad6f-4d97-974f-ab73fe47e883", "name": "network-vif-plugged", "status": "completed", "tag": "48d76af5-e9ed-47d1-8aac-d9f2968f698e"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:35:08.107968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-e9ad97bd-789d-4865-875b-c56a7732c98a req-9ee0340f-e3bb-48b0-ad45-6a20fcc3e404 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:08.108177 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-e9ad97bd-789d-4865-875b-c56a7732c98a req-9ee0340f-e3bb-48b0-ad45-6a20fcc3e404 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:08.122956 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-e9ad97bd-789d-4865-875b-c56a7732c98a req-9ee0340f-e3bb-48b0-ad45-6a20fcc3e404 service nova] Creating event network-vif-plugged:48d76af5-e9ed-47d1-8aac-d9f2968f698e for instance ae09253b-ad6f-4d97-974f-ab73fe47e883 on hv-cinder-84779 Jun 27 15:35:08.128455 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-e9ad97bd-789d-4865-875b-c56a7732c98a req-9ee0340f-e3bb-48b0-ad45-6a20fcc3e404 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058735 Jun 27 15:35:08.129776 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 491/979] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:35:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:35:08.985659 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1609a194-7479-4c46-a717-1eae5c885322 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:08.986830 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1609a194-7479-4c46-a717-1eae5c885322 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:08.989794 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:08.999951 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1609a194-7479-4c46-a717-1eae5c885322 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:09.000672 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1609a194-7479-4c46-a717-1eae5c885322 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:09.001902 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1609a194-7479-4c46-a717-1eae5c885322 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:09.002626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1609a194-7479-4c46-a717-1eae5c885322 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:09.172412 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1609a194-7479-4c46-a717-1eae5c885322 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:09.180876 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1609a194-7479-4c46-a717-1eae5c885322 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1315 microversion: 2.1 time: 0.202229 Jun 27 15:35:09.181469 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 489/980] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:08 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:10.199245 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:10.204904 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-abb5d216-7d4d-425d-bec2-ba15baff97e5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:10.205659 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-abb5d216-7d4d-425d-bec2-ba15baff97e5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:10.212770 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abb5d216-7d4d-425d-bec2-ba15baff97e5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:10.213225 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abb5d216-7d4d-425d-bec2-ba15baff97e5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:10.214018 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abb5d216-7d4d-425d-bec2-ba15baff97e5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:10.214449 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-abb5d216-7d4d-425d-bec2-ba15baff97e5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:10.382731 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-abb5d216-7d4d-425d-bec2-ba15baff97e5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:10.395224 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-abb5d216-7d4d-425d-bec2-ba15baff97e5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1465 microversion: 2.1 time: 0.197418 Jun 27 15:35:10.396014 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 492/981] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:10 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1465 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:10.439952 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c92efabc-2f20-496e-b106-76edb0737417 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:10.440630 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c92efabc-2f20-496e-b106-76edb0737417 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:10.448005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c92efabc-2f20-496e-b106-76edb0737417 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:10.448488 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c92efabc-2f20-496e-b106-76edb0737417 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:10.449412 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c92efabc-2f20-496e-b106-76edb0737417 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:10.449798 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c92efabc-2f20-496e-b106-76edb0737417 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:10.480589 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c92efabc-2f20-496e-b106-76edb0737417 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:35:10.587611 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c92efabc-2f20-496e-b106-76edb0737417 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 204 len: 0 microversion: 2.1 time: 0.148769 Jun 27 15:35:10.588291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 490/982] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:35:10 2022] DELETE /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:35:10.596776 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f805e4f0-6def-4991-aeff-c79eb794a585 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:10.597749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f805e4f0-6def-4991-aeff-c79eb794a585 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:10.604425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f805e4f0-6def-4991-aeff-c79eb794a585 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:10.604879 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f805e4f0-6def-4991-aeff-c79eb794a585 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:10.605903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f805e4f0-6def-4991-aeff-c79eb794a585 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:10.606336 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f805e4f0-6def-4991-aeff-c79eb794a585 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:10.781649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f805e4f0-6def-4991-aeff-c79eb794a585 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:10.790645 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f805e4f0-6def-4991-aeff-c79eb794a585 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1471 microversion: 2.1 time: 0.197826 Jun 27 15:35:10.791246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 493/983] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:10 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1471 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:11.819700 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-eca31be9-46d2-4afa-9dcb-ff31fe887973 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:11.820495 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-eca31be9-46d2-4afa-9dcb-ff31fe887973 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:11.829197 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eca31be9-46d2-4afa-9dcb-ff31fe887973 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:11.829755 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eca31be9-46d2-4afa-9dcb-ff31fe887973 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:11.830890 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eca31be9-46d2-4afa-9dcb-ff31fe887973 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:11.831527 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-eca31be9-46d2-4afa-9dcb-ff31fe887973 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:11.996514 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-eca31be9-46d2-4afa-9dcb-ff31fe887973 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:12.004709 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-eca31be9-46d2-4afa-9dcb-ff31fe887973 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1471 microversion: 2.1 time: 0.191485 Jun 27 15:35:12.005324 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 491/984] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:11 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1471 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:12.799237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-90808f9a-e556-4d22-84c8-e6888419160f req-1df690cc-428f-408f-a515-a5f5346c2bab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ae09253b-ad6f-4d97-974f-ab73fe47e883", "name": "network-vif-deleted", "tag": "48d76af5-e9ed-47d1-8aac-d9f2968f698e"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:35:12.819873 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-90808f9a-e556-4d22-84c8-e6888419160f req-1df690cc-428f-408f-a515-a5f5346c2bab service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:12.820361 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-90808f9a-e556-4d22-84c8-e6888419160f req-1df690cc-428f-408f-a515-a5f5346c2bab service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:12.834415 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-90808f9a-e556-4d22-84c8-e6888419160f req-1df690cc-428f-408f-a515-a5f5346c2bab service nova] Creating event network-vif-deleted:48d76af5-e9ed-47d1-8aac-d9f2968f698e for instance ae09253b-ad6f-4d97-974f-ab73fe47e883 on hv-cinder-84779 Jun 27 15:35:12.842704 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-90808f9a-e556-4d22-84c8-e6888419160f req-1df690cc-428f-408f-a515-a5f5346c2bab service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048550 Jun 27 15:35:12.843608 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 494/985] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:35:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:35:13.023260 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:13.023873 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:13.031951 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:13.032345 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:13.033105 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:13.033535 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:13.073845 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:13.074294 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:13.074770 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lazy-loading 'fault' on Instance uuid ae09253b-ad6f-4d97-974f-ab73fe47e883 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:35:13.125688 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3b100ef05c594d18b3868c2d0cb4f175', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ef1f8afa02043918b4e76f9af38d47f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:13.137217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b102498d-c235-4fa7-8826-89e25c373b95 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 200 len: 1305 microversion: 2.1 time: 0.117774 Jun 27 15:35:13.137951 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 492/986] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:13 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 1305 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:14.156899 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-877e639b-09c5-4bad-b73c-b46c59103ef5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:14.157581 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-877e639b-09c5-4bad-b73c-b46c59103ef5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] [instance: ae09253b-ad6f-4d97-974f-ab73fe47e883] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:14.169501 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-877e639b-09c5-4bad-b73c-b46c59103ef5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:14.170070 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-877e639b-09c5-4bad-b73c-b46c59103ef5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:14.170937 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-877e639b-09c5-4bad-b73c-b46c59103ef5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:14.171560 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-877e639b-09c5-4bad-b73c-b46c59103ef5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:14.188509 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-877e639b-09c5-4bad-b73c-b46c59103ef5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] HTTP exception thrown: Instance ae09253b-ad6f-4d97-974f-ab73fe47e883 could not be found. Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-877e639b-09c5-4bad-b73c-b46c59103ef5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Request method failure captured: Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 HTTP/1.1 Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiuc4fR92sjEbyyKpZ9h53yXtmTwWnXnc_BWpxRyuDeAkWYaK_KI7KoyGIli_QkcArykoaX09nyeb5SaxlC5KpHVlZFrHbExX5pTLpdxnHhaWVEsb5EfPygQrdUCWHsdLpURSJct-Fd-wxbvQGMaA542AG8Ox0pLd_OcW2up6wQL7F-VQ Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: 7ef1f8afa02043918b4e76f9af38d47f Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-VolumesNegativeTest-211072487 Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:35:14.190167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_7ef1f8afa02043918b4e76f9af38d47f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/7ef1f8afa02043918b4e76f9af38d47f"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7ef1f8afa02043918b4e76f9af38d47f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/7ef1f8afa02043918b4e76f9af38d47f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-VolumesNegativeTest-211072487 Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: 7ef1f8afa02043918b4e76f9af38d47f Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-VolumesNegativeTest-211072487 Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-VolumesNegativeTest-211072487-project Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 3b100ef05c594d18b3868c2d0cb4f175 Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-VolumesNegativeTest-211072487-project Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance ae09253b-ad6f-4d97-974f-ab73fe47e883 could not be found. Jun 27 15:35:14.191840 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'ae09253b-ad6f-4d97-974f-ab73fe47e883'} Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ae09253b-ad6f-4d97-974f-ab73fe47e883 could not be found. Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:35:14.192913 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ae09253b-ad6f-4d97-974f-ab73fe47e883 could not be found. Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ae09253b-ad6f-4d97-974f-ab73fe47e883 could not be found. Jun 27 15:35:14.194286 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:35:14.195959 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-877e639b-09c5-4bad-b73c-b46c59103ef5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] Returning 404 to user: Instance ae09253b-ad6f-4d97-974f-ab73fe47e883 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:35:14.195959 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-877e639b-09c5-4bad-b73c-b46c59103ef5 tempest-VolumesNegativeTest-211072487 tempest-VolumesNegativeTest-211072487-project] 10.222.0.26 "GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883" status: 404 len: 111 microversion: 2.1 time: 0.040175 Jun 27 15:35:14.195959 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 495/987] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:14 2022] GET /compute/v2.1/servers/ae09253b-ad6f-4d97-974f-ab73fe47e883 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:35:31.755908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:31.756957 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:32.040424 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-35faae2a-bfd7-4c30-849f-af04690a58d3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Action: 'create', calling method: .version_select at 0x7fb27371a5e0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-739718795", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAbyU7eSifAzcCtQogyAwfV9bXyinoncqaU7YA9z5sSMtKC7b41jPNFHsEAfS1VIjCnhbScySZKRaD6hubgu4QeryzuW5icU6eEFLnOBRuuhLFWgKn1/tgsklot1iFf1Ng=="}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:35:32.059632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-35faae2a-bfd7-4c30-849f-af04690a58d3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Getting quotas for project bf83328eefb741d086f33cd650fd3942. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:35:32.063836 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-35faae2a-bfd7-4c30-849f-af04690a58d3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Getting quotas for user 6401f2aaa0af4708953b42863aa25de0 and project bf83328eefb741d086f33cd650fd3942. Resources: {'key_pairs'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:35:32.094007 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-35faae2a-bfd7-4c30-849f-af04690a58d3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.343859 Jun 27 15:35:32.094718 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 493/988] 10.222.0.26 () {60 vars in 1158 bytes} [Mon Jun 27 15:35:31 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:35:50.673993 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2031943467", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-739718795", "security_groups": [{"name": "tempest-secgroup-smoke-1949080385"}], "block_device_mapping_v2": [{"uuid": "edadf0b1-9751-4caa-ac9f-f4f7f2c967d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09bbc698-5eb1-420c-a302-7f9a1544cd53"}]}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:35:50.682757 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=13 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:50.683413 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=29 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:50.810255 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] validate_networks() for [('09bbc698-5eb1-420c-a302-7f9a1544cd53', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:35:51.515973 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:35:51.516446 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:35:51.516950 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:35:51.517350 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:35:51.517786 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:35:51.528059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:51.528548 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:51.529356 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:51.529790 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:51.548775 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Getting quotas for project bf83328eefb741d086f33cd650fd3942. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:35:51.553864 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Getting quotas for user 6401f2aaa0af4708953b42863aa25de0 and project bf83328eefb741d086f33cd650fd3942. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:35:51.623763 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:35:51.627528 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edadf0b1-9751-4caa-ac9f-f4f7f2c967d8',volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:35:51.808997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e1f83871-aa11-4dd9-8086-db2d5a1bbe05 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.138666 Jun 27 15:35:51.808997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 496/989] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:35:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:35:51.816911 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=4 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:51.817697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:35:51.822422 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-de77fdf1-21eb-4c1f-819d-db111c05bd46 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:51.823047 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-de77fdf1-21eb-4c1f-819d-db111c05bd46 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:51.880440 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-de77fdf1-21eb-4c1f-819d-db111c05bd46 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:51.887676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-de77fdf1-21eb-4c1f-819d-db111c05bd46 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1094 microversion: 2.1 time: 0.072315 Jun 27 15:35:51.888984 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 494/990] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:51 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:52.905693 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fd55d10b-3ac7-47cd-a9c5-d89310eb87bf tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:52.906313 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-fd55d10b-3ac7-47cd-a9c5-d89310eb87bf tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:52.961314 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-fd55d10b-3ac7-47cd-a9c5-d89310eb87bf tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:52.968640 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fd55d10b-3ac7-47cd-a9c5-d89310eb87bf tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1094 microversion: 2.1 time: 0.067625 Jun 27 15:35:52.969230 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 497/991] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:52 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:53.986291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2b8b8a1c-bfde-4067-91dc-ff4b172ee603 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:53.987007 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2b8b8a1c-bfde-4067-91dc-ff4b172ee603 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:53.994966 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2b8b8a1c-bfde-4067-91dc-ff4b172ee603 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:53.995412 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2b8b8a1c-bfde-4067-91dc-ff4b172ee603 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:53.996179 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2b8b8a1c-bfde-4067-91dc-ff4b172ee603 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:53.996726 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2b8b8a1c-bfde-4067-91dc-ff4b172ee603 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:54.065828 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2b8b8a1c-bfde-4067-91dc-ff4b172ee603 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:54.078889 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2b8b8a1c-bfde-4067-91dc-ff4b172ee603 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1144 microversion: 2.1 time: 0.096056 Jun 27 15:35:54.079580 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 495/992] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:53 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1144 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:55.103026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-26ec3583-6ffe-4e4b-afd2-a01c39a090a9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:55.103974 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-26ec3583-6ffe-4e4b-afd2-a01c39a090a9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:55.112871 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-26ec3583-6ffe-4e4b-afd2-a01c39a090a9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:55.113318 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-26ec3583-6ffe-4e4b-afd2-a01c39a090a9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:55.114193 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-26ec3583-6ffe-4e4b-afd2-a01c39a090a9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:55.114623 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-26ec3583-6ffe-4e4b-afd2-a01c39a090a9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:55.187138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-26ec3583-6ffe-4e4b-afd2-a01c39a090a9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:55.195623 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-26ec3583-6ffe-4e4b-afd2-a01c39a090a9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1210 microversion: 2.1 time: 0.098958 Jun 27 15:35:55.196194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 498/993] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:55 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:56.213773 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-8108378f-3537-4f80-aa9e-7c7ad6a1b68e tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:56.214415 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-8108378f-3537-4f80-aa9e-7c7ad6a1b68e tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:56.221734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8108378f-3537-4f80-aa9e-7c7ad6a1b68e tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:56.222469 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8108378f-3537-4f80-aa9e-7c7ad6a1b68e tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:56.223448 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8108378f-3537-4f80-aa9e-7c7ad6a1b68e tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:56.223938 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-8108378f-3537-4f80-aa9e-7c7ad6a1b68e tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:56.338537 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-f1e502ef-9301-4201-a6de-0e2b27d76dbe req-8861410b-0fd3-4ddc-9511-aaccc97444c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64daf70-81db-49be-8de8-4900c3f76376", "tag": "47374d7b-7e06-44d7-a9da-7f84a58ae0aa"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:35:56.356127 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-f1e502ef-9301-4201-a6de-0e2b27d76dbe req-8861410b-0fd3-4ddc-9511-aaccc97444c6 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:56.357087 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-f1e502ef-9301-4201-a6de-0e2b27d76dbe req-8861410b-0fd3-4ddc-9511-aaccc97444c6 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:56.374411 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-f1e502ef-9301-4201-a6de-0e2b27d76dbe req-8861410b-0fd3-4ddc-9511-aaccc97444c6 service nova] Creating event network-changed:47374d7b-7e06-44d7-a9da-7f84a58ae0aa for instance c64daf70-81db-49be-8de8-4900c3f76376 on hv-cinder-84779 Jun 27 15:35:56.381949 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-f1e502ef-9301-4201-a6de-0e2b27d76dbe req-8861410b-0fd3-4ddc-9511-aaccc97444c6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048487 Jun 27 15:35:56.382878 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 499/994] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:35:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 15:35:56.399065 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-8108378f-3537-4f80-aa9e-7c7ad6a1b68e tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:56.409073 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-8108378f-3537-4f80-aa9e-7c7ad6a1b68e tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.198874 Jun 27 15:35:56.410016 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 496/995] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:56 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:57.427754 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-c61577e7-5d8c-46e7-9a44-defa87a58bb6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:57.428487 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-c61577e7-5d8c-46e7-9a44-defa87a58bb6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:57.435836 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c61577e7-5d8c-46e7-9a44-defa87a58bb6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:57.436236 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c61577e7-5d8c-46e7-9a44-defa87a58bb6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:57.437018 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c61577e7-5d8c-46e7-9a44-defa87a58bb6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:57.437450 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-c61577e7-5d8c-46e7-9a44-defa87a58bb6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:57.595129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-c61577e7-5d8c-46e7-9a44-defa87a58bb6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:57.603174 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-c61577e7-5d8c-46e7-9a44-defa87a58bb6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.180487 Jun 27 15:35:57.603748 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 500/996] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:57 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:58.620491 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-371d0158-2fac-4ecf-90a8-ce40d51f4e44 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:58.621132 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-371d0158-2fac-4ecf-90a8-ce40d51f4e44 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:58.628752 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-371d0158-2fac-4ecf-90a8-ce40d51f4e44 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:58.629217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-371d0158-2fac-4ecf-90a8-ce40d51f4e44 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:58.629973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-371d0158-2fac-4ecf-90a8-ce40d51f4e44 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:58.630394 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-371d0158-2fac-4ecf-90a8-ce40d51f4e44 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:58.773632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-371d0158-2fac-4ecf-90a8-ce40d51f4e44 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:58.786634 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-371d0158-2fac-4ecf-90a8-ce40d51f4e44 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.170056 Jun 27 15:35:58.787207 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 497/997] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:58 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:35:59.803982 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-6d47183c-ed07-42de-a32b-6b8e30bc5931 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:35:59.804852 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-6d47183c-ed07-42de-a32b-6b8e30bc5931 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:35:59.812573 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d47183c-ed07-42de-a32b-6b8e30bc5931 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:59.813421 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d47183c-ed07-42de-a32b-6b8e30bc5931 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:59.814318 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d47183c-ed07-42de-a32b-6b8e30bc5931 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:35:59.814750 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-6d47183c-ed07-42de-a32b-6b8e30bc5931 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:35:59.958644 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-6d47183c-ed07-42de-a32b-6b8e30bc5931 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:35:59.969254 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-6d47183c-ed07-42de-a32b-6b8e30bc5931 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.169048 Jun 27 15:35:59.970016 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 501/998] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:35:59 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:00.988218 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-041bd2a7-e31f-4806-a366-76153b6c0195 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:00.988827 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-041bd2a7-e31f-4806-a366-76153b6c0195 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:00.995632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-041bd2a7-e31f-4806-a366-76153b6c0195 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:00.996061 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-041bd2a7-e31f-4806-a366-76153b6c0195 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:00.996877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-041bd2a7-e31f-4806-a366-76153b6c0195 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:00.997303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-041bd2a7-e31f-4806-a366-76153b6c0195 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:01.147470 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-041bd2a7-e31f-4806-a366-76153b6c0195 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:01.155787 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-041bd2a7-e31f-4806-a366-76153b6c0195 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.172198 Jun 27 15:36:01.156436 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 498/999] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:00 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:02.175791 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d5e204c2-6765-4d95-90f6-40e7700865d2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:02.176595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d5e204c2-6765-4d95-90f6-40e7700865d2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:02.179273 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:36:02.184970 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d5e204c2-6765-4d95-90f6-40e7700865d2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:02.185421 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d5e204c2-6765-4d95-90f6-40e7700865d2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:02.186205 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d5e204c2-6765-4d95-90f6-40e7700865d2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:02.186636 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d5e204c2-6765-4d95-90f6-40e7700865d2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:02.328942 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d5e204c2-6765-4d95-90f6-40e7700865d2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:02.338832 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d5e204c2-6765-4d95-90f6-40e7700865d2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.168702 Jun 27 15:36:02.339404 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 502/1000] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:02 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:03.133151 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-bea7dff2-46c9-473e-801d-e7ea41130e7e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:36:03.133857 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-bea7dff2-46c9-473e-801d-e7ea41130e7e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:03.136529 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:36:03.144225 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bea7dff2-46c9-473e-801d-e7ea41130e7e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:03.144708 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bea7dff2-46c9-473e-801d-e7ea41130e7e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:03.145490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bea7dff2-46c9-473e-801d-e7ea41130e7e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:03.145928 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-bea7dff2-46c9-473e-801d-e7ea41130e7e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:03.175595 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.objects.instance [None req-bea7dff2-46c9-473e-801d-e7ea41130e7e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lazy-loading 'flavor' on Instance uuid e7d3f4f1-4158-4a2f-8568-5cea794cdf31 {{(pid=117978) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:36:03.255663 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-bea7dff2-46c9-473e-801d-e7ea41130e7e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "POST /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31/action" status: 202 len: 0 microversion: 2.1 time: 0.128915 Jun 27 15:36:03.256235 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 499/1001] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:36:03 2022] POST /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31/action => generated 0 bytes in 130 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:36:03.264686 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e57677d6-54c2-4f3c-8c53-d150c6c9d7f7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:03.266609 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e57677d6-54c2-4f3c-8c53-d150c6c9d7f7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:03.268751 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=8 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:36:03.274894 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e57677d6-54c2-4f3c-8c53-d150c6c9d7f7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:03.275393 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e57677d6-54c2-4f3c-8c53-d150c6c9d7f7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:03.276113 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e57677d6-54c2-4f3c-8c53-d150c6c9d7f7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:03.276605 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e57677d6-54c2-4f3c-8c53-d150c6c9d7f7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:03.356277 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ea6e566b-c8b6-4f5b-a4b9-8400d7503a49 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:03.357118 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ea6e566b-c8b6-4f5b-a4b9-8400d7503a49 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:03.364554 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea6e566b-c8b6-4f5b-a4b9-8400d7503a49 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:03.365048 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea6e566b-c8b6-4f5b-a4b9-8400d7503a49 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:03.365817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea6e566b-c8b6-4f5b-a4b9-8400d7503a49 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:03.366385 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ea6e566b-c8b6-4f5b-a4b9-8400d7503a49 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:03.419014 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e57677d6-54c2-4f3c-8c53-d150c6c9d7f7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:03.430811 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e57677d6-54c2-4f3c-8c53-d150c6c9d7f7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.169971 Jun 27 15:36:03.432072 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 503/1002] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:03 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:03.514644 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ea6e566b-c8b6-4f5b-a4b9-8400d7503a49 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:03.522308 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ea6e566b-c8b6-4f5b-a4b9-8400d7503a49 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.170308 Jun 27 15:36:03.522878 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 500/1003] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:03 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:36:04.449465 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-51d8961d-e483-44d8-af82-934a715471c7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:04.450054 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-51d8961d-e483-44d8-af82-934a715471c7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:04.457466 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-51d8961d-e483-44d8-af82-934a715471c7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:04.457920 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-51d8961d-e483-44d8-af82-934a715471c7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:04.458692 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-51d8961d-e483-44d8-af82-934a715471c7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:04.459129 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-51d8961d-e483-44d8-af82-934a715471c7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:04.539692 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-56eb6779-0d83-48ad-b5ea-33f0e6ae5506 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:04.540302 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-56eb6779-0d83-48ad-b5ea-33f0e6ae5506 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:04.547222 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56eb6779-0d83-48ad-b5ea-33f0e6ae5506 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:04.547665 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56eb6779-0d83-48ad-b5ea-33f0e6ae5506 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:04.548460 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56eb6779-0d83-48ad-b5ea-33f0e6ae5506 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:04.548877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-56eb6779-0d83-48ad-b5ea-33f0e6ae5506 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:04.593152 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-51d8961d-e483-44d8-af82-934a715471c7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:04.600903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-51d8961d-e483-44d8-af82-934a715471c7 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.155377 Jun 27 15:36:04.601482 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 504/1004] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:04 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:04.689730 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-56eb6779-0d83-48ad-b5ea-33f0e6ae5506 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:04.697758 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-56eb6779-0d83-48ad-b5ea-33f0e6ae5506 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.162014 Jun 27 15:36:04.698292 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 501/1005] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:04 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:05.621579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-aa80c204-c8b4-4770-8f16-50698baa307e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:05.622222 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-aa80c204-c8b4-4770-8f16-50698baa307e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:05.631026 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aa80c204-c8b4-4770-8f16-50698baa307e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:05.631474 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aa80c204-c8b4-4770-8f16-50698baa307e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:05.632237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aa80c204-c8b4-4770-8f16-50698baa307e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:05.632702 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-aa80c204-c8b4-4770-8f16-50698baa307e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:05.715454 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-3b187518-4bff-4e6a-be51-0883cfa47a0d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:05.716099 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-3b187518-4bff-4e6a-be51-0883cfa47a0d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:05.722909 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b187518-4bff-4e6a-be51-0883cfa47a0d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:05.723354 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b187518-4bff-4e6a-be51-0883cfa47a0d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:05.724129 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b187518-4bff-4e6a-be51-0883cfa47a0d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:05.724585 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-3b187518-4bff-4e6a-be51-0883cfa47a0d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:05.774591 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-aa80c204-c8b4-4770-8f16-50698baa307e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:05.782406 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-aa80c204-c8b4-4770-8f16-50698baa307e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.166597 Jun 27 15:36:05.782972 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 505/1006] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:05 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:05.864432 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-3b187518-4bff-4e6a-be51-0883cfa47a0d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:05.872933 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-3b187518-4bff-4e6a-be51-0883cfa47a0d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.161490 Jun 27 15:36:05.873510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 502/1007] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:05 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:06.802691 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-966569ff-06fb-4200-a32e-f1e9681019d2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:06.803319 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-966569ff-06fb-4200-a32e-f1e9681019d2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:06.810587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-966569ff-06fb-4200-a32e-f1e9681019d2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:06.811032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-966569ff-06fb-4200-a32e-f1e9681019d2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:06.811787 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-966569ff-06fb-4200-a32e-f1e9681019d2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:06.812214 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-966569ff-06fb-4200-a32e-f1e9681019d2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:06.890223 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d748dcf4-2d6e-41e3-871f-6d9a101cb2e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:06.890859 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d748dcf4-2d6e-41e3-871f-6d9a101cb2e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:06.898558 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d748dcf4-2d6e-41e3-871f-6d9a101cb2e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:06.899011 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d748dcf4-2d6e-41e3-871f-6d9a101cb2e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:06.899813 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d748dcf4-2d6e-41e3-871f-6d9a101cb2e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:06.900247 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d748dcf4-2d6e-41e3-871f-6d9a101cb2e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:07.043346 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d748dcf4-2d6e-41e3-871f-6d9a101cb2e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:07.051884 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d748dcf4-2d6e-41e3-871f-6d9a101cb2e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.165359 Jun 27 15:36:07.052632 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 503/1008] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:06 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:07.107358 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-966569ff-06fb-4200-a32e-f1e9681019d2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:07.115112 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-966569ff-06fb-4200-a32e-f1e9681019d2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.318115 Jun 27 15:36:07.115676 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 506/1009] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:06 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:08.069941 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-b3408b0f-2c05-4ee8-9e75-ced95913081b tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:08.070547 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-b3408b0f-2c05-4ee8-9e75-ced95913081b tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:08.077792 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3408b0f-2c05-4ee8-9e75-ced95913081b tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:08.078209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3408b0f-2c05-4ee8-9e75-ced95913081b tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:08.079005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3408b0f-2c05-4ee8-9e75-ced95913081b tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:08.079627 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-b3408b0f-2c05-4ee8-9e75-ced95913081b tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:08.135470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d16d202e-9c4f-495c-bb50-282e5df9b870 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:08.135953 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-d16d202e-9c4f-495c-bb50-282e5df9b870 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:08.144115 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d16d202e-9c4f-495c-bb50-282e5df9b870 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:08.144493 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d16d202e-9c4f-495c-bb50-282e5df9b870 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:08.145262 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d16d202e-9c4f-495c-bb50-282e5df9b870 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:08.145906 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-d16d202e-9c4f-495c-bb50-282e5df9b870 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:08.227483 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-b3408b0f-2c05-4ee8-9e75-ced95913081b tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:08.235398 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-b3408b0f-2c05-4ee8-9e75-ced95913081b tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.169599 Jun 27 15:36:08.236217 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 504/1010] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:08 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:08.300174 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-d16d202e-9c4f-495c-bb50-282e5df9b870 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:08.308452 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d16d202e-9c4f-495c-bb50-282e5df9b870 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.176847 Jun 27 15:36:08.309015 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 507/1011] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:08 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:09.258412 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-609a7579-475c-48ad-a328-618eecc0d608 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:09.258932 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-609a7579-475c-48ad-a328-618eecc0d608 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:09.266048 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-609a7579-475c-48ad-a328-618eecc0d608 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:09.266473 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-609a7579-475c-48ad-a328-618eecc0d608 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:09.267256 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-609a7579-475c-48ad-a328-618eecc0d608 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:09.267689 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-609a7579-475c-48ad-a328-618eecc0d608 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:09.326925 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4389fc85-2203-4c2b-8e6d-e7e7bb1b68fc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:09.327567 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4389fc85-2203-4c2b-8e6d-e7e7bb1b68fc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:09.335184 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4389fc85-2203-4c2b-8e6d-e7e7bb1b68fc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:09.335617 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4389fc85-2203-4c2b-8e6d-e7e7bb1b68fc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:09.336423 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4389fc85-2203-4c2b-8e6d-e7e7bb1b68fc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:09.336847 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4389fc85-2203-4c2b-8e6d-e7e7bb1b68fc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:09.430801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-609a7579-475c-48ad-a328-618eecc0d608 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:09.439685 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-609a7579-475c-48ad-a328-618eecc0d608 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.187730 Jun 27 15:36:09.440259 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 505/1012] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:09 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:09.481167 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4389fc85-2203-4c2b-8e6d-e7e7bb1b68fc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:09.490649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4389fc85-2203-4c2b-8e6d-e7e7bb1b68fc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.167489 Jun 27 15:36:09.491566 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 508/1013] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:09 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:36:09.786067 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-3c8aeaae-d16e-4087-b4da-e88ad5c44874 req-ec425d44-3ddd-4fe5-9cf2-fd48b6806a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64daf70-81db-49be-8de8-4900c3f76376", "name": "network-vif-plugged", "status": "completed", "tag": "47374d7b-7e06-44d7-a9da-7f84a58ae0aa"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:36:09.794898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-3c8aeaae-d16e-4087-b4da-e88ad5c44874 req-ec425d44-3ddd-4fe5-9cf2-fd48b6806a87 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:09.795462 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-3c8aeaae-d16e-4087-b4da-e88ad5c44874 req-ec425d44-3ddd-4fe5-9cf2-fd48b6806a87 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:09.808480 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-3c8aeaae-d16e-4087-b4da-e88ad5c44874 req-ec425d44-3ddd-4fe5-9cf2-fd48b6806a87 service nova] Creating event network-vif-plugged:47374d7b-7e06-44d7-a9da-7f84a58ae0aa for instance c64daf70-81db-49be-8de8-4900c3f76376 on hv-cinder-84779 Jun 27 15:36:09.813651 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-3c8aeaae-d16e-4087-b4da-e88ad5c44874 req-ec425d44-3ddd-4fe5-9cf2-fd48b6806a87 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031375 Jun 27 15:36:09.814409 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 506/1014] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:36:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:36:10.457773 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1cbfe469-f6b6-4629-b423-6eea228a1798 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:10.458796 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-1cbfe469-f6b6-4629-b423-6eea228a1798 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:10.465903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1cbfe469-f6b6-4629-b423-6eea228a1798 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:10.466445 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1cbfe469-f6b6-4629-b423-6eea228a1798 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:10.467372 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1cbfe469-f6b6-4629-b423-6eea228a1798 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:10.467784 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1cbfe469-f6b6-4629-b423-6eea228a1798 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:10.508546 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fc55a4f4-1fd7-46a3-93b9-8746ae8daef5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:10.510109 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fc55a4f4-1fd7-46a3-93b9-8746ae8daef5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:10.518192 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc55a4f4-1fd7-46a3-93b9-8746ae8daef5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:10.518794 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc55a4f4-1fd7-46a3-93b9-8746ae8daef5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:10.519849 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc55a4f4-1fd7-46a3-93b9-8746ae8daef5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:10.520456 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fc55a4f4-1fd7-46a3-93b9-8746ae8daef5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:10.609507 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1cbfe469-f6b6-4629-b423-6eea228a1798 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:10.617282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-1cbfe469-f6b6-4629-b423-6eea228a1798 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1266 microversion: 2.1 time: 0.164774 Jun 27 15:36:10.617870 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 509/1015] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:10 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:10.664354 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fc55a4f4-1fd7-46a3-93b9-8746ae8daef5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:10.672921 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fc55a4f4-1fd7-46a3-93b9-8746ae8daef5 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.169535 Jun 27 15:36:10.673486 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 507/1016] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:10 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:36:11.636266 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b8c76af9-3d9d-4aff-8a5b-d9644a6f3856 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:11.637039 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b8c76af9-3d9d-4aff-8a5b-d9644a6f3856 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:11.644496 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8c76af9-3d9d-4aff-8a5b-d9644a6f3856 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:11.644743 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8c76af9-3d9d-4aff-8a5b-d9644a6f3856 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:11.645522 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8c76af9-3d9d-4aff-8a5b-d9644a6f3856 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:11.645983 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8c76af9-3d9d-4aff-8a5b-d9644a6f3856 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:11.694678 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7fba186f-ddcb-48f6-a8e5-9f3c2e805ad3 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:11.695291 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7fba186f-ddcb-48f6-a8e5-9f3c2e805ad3 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:11.702200 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fba186f-ddcb-48f6-a8e5-9f3c2e805ad3 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:11.702667 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fba186f-ddcb-48f6-a8e5-9f3c2e805ad3 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:11.703428 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fba186f-ddcb-48f6-a8e5-9f3c2e805ad3 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:11.703861 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7fba186f-ddcb-48f6-a8e5-9f3c2e805ad3 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:11.785785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b8c76af9-3d9d-4aff-8a5b-d9644a6f3856 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:11.794503 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b8c76af9-3d9d-4aff-8a5b-d9644a6f3856 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1452 microversion: 2.1 time: 0.163996 Jun 27 15:36:11.795062 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 510/1017] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:11 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1452 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:11.812150 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-0ba3ffd4-06cc-4c68-a607-7496825cbd3f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:11.812910 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-0ba3ffd4-06cc-4c68-a607-7496825cbd3f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:11.819024 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0ba3ffd4-06cc-4c68-a607-7496825cbd3f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:11.819559 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0ba3ffd4-06cc-4c68-a607-7496825cbd3f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:11.820455 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0ba3ffd4-06cc-4c68-a607-7496825cbd3f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:11.821113 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-0ba3ffd4-06cc-4c68-a607-7496825cbd3f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:11.842475 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7fba186f-ddcb-48f6-a8e5-9f3c2e805ad3 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:11.851108 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7fba186f-ddcb-48f6-a8e5-9f3c2e805ad3 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.163772 Jun 27 15:36:11.852363 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 508/1018] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:11 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:11.970042 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-0ba3ffd4-06cc-4c68-a607-7496825cbd3f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:11.978172 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-0ba3ffd4-06cc-4c68-a607-7496825cbd3f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1452 microversion: 2.1 time: 0.169888 Jun 27 15:36:11.978748 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 511/1019] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:11 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1452 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:12.872101 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-050dc56e-c87b-47e3-ace5-37e7b08881dd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:12.872935 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-050dc56e-c87b-47e3-ace5-37e7b08881dd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:12.880503 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-050dc56e-c87b-47e3-ace5-37e7b08881dd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:12.881406 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-050dc56e-c87b-47e3-ace5-37e7b08881dd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:12.882479 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-050dc56e-c87b-47e3-ace5-37e7b08881dd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:12.882989 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-050dc56e-c87b-47e3-ace5-37e7b08881dd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:13.030817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-050dc56e-c87b-47e3-ace5-37e7b08881dd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:13.038726 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-050dc56e-c87b-47e3-ace5-37e7b08881dd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.174130 Jun 27 15:36:13.039310 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 509/1020] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:12 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:13.835619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-d7813778-8763-4ca4-8194-ac201df47e48 req-ed9fa410-050b-4bcc-94a9-68483502b046 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c64daf70-81db-49be-8de8-4900c3f76376", "tag": "47374d7b-7e06-44d7-a9da-7f84a58ae0aa"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:36:13.844533 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-d7813778-8763-4ca4-8194-ac201df47e48 req-ed9fa410-050b-4bcc-94a9-68483502b046 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:13.845258 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-d7813778-8763-4ca4-8194-ac201df47e48 req-ed9fa410-050b-4bcc-94a9-68483502b046 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:13.858857 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-d7813778-8763-4ca4-8194-ac201df47e48 req-ed9fa410-050b-4bcc-94a9-68483502b046 service nova] Creating event network-changed:47374d7b-7e06-44d7-a9da-7f84a58ae0aa for instance c64daf70-81db-49be-8de8-4900c3f76376 on hv-cinder-84779 Jun 27 15:36:13.864245 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-d7813778-8763-4ca4-8194-ac201df47e48 req-ed9fa410-050b-4bcc-94a9-68483502b046 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032640 Jun 27 15:36:13.868554 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 512/1021] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:36:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:36:14.057549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-7188f974-4266-4fde-9e21-0f3df45aa083 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:14.058223 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-7188f974-4266-4fde-9e21-0f3df45aa083 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:14.066944 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7188f974-4266-4fde-9e21-0f3df45aa083 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:14.067733 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7188f974-4266-4fde-9e21-0f3df45aa083 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:14.070213 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7188f974-4266-4fde-9e21-0f3df45aa083 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:14.071134 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-7188f974-4266-4fde-9e21-0f3df45aa083 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:14.076583 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:36:14.246370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-7188f974-4266-4fde-9e21-0f3df45aa083 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:14.258423 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-7188f974-4266-4fde-9e21-0f3df45aa083 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.207114 Jun 27 15:36:14.267917 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 510/1022] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:14 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:15.276122 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-11a3e8a7-e24c-412b-9090-9c34af546ce2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:15.276912 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-11a3e8a7-e24c-412b-9090-9c34af546ce2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:15.284295 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-11a3e8a7-e24c-412b-9090-9c34af546ce2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:15.284771 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-11a3e8a7-e24c-412b-9090-9c34af546ce2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:15.285550 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-11a3e8a7-e24c-412b-9090-9c34af546ce2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:15.285985 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-11a3e8a7-e24c-412b-9090-9c34af546ce2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:15.433786 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-11a3e8a7-e24c-412b-9090-9c34af546ce2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:15.444701 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-11a3e8a7-e24c-412b-9090-9c34af546ce2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.172916 Jun 27 15:36:15.445278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 513/1023] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:15 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:16.463053 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c5963297-6a50-4f29-8b08-46f0edac8eff tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:16.463716 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c5963297-6a50-4f29-8b08-46f0edac8eff tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:16.471003 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5963297-6a50-4f29-8b08-46f0edac8eff tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:16.471451 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5963297-6a50-4f29-8b08-46f0edac8eff tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:16.472227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5963297-6a50-4f29-8b08-46f0edac8eff tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:16.472681 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c5963297-6a50-4f29-8b08-46f0edac8eff tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:16.625900 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c5963297-6a50-4f29-8b08-46f0edac8eff tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:16.633825 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c5963297-6a50-4f29-8b08-46f0edac8eff tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.175567 Jun 27 15:36:16.634395 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 511/1024] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:16 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:17.652113 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-4ebf2577-d3f1-46e2-956e-48bc8e03ec6a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:17.652787 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-4ebf2577-d3f1-46e2-956e-48bc8e03ec6a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:17.659767 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4ebf2577-d3f1-46e2-956e-48bc8e03ec6a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:17.660210 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4ebf2577-d3f1-46e2-956e-48bc8e03ec6a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:17.661021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4ebf2577-d3f1-46e2-956e-48bc8e03ec6a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:17.661449 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-4ebf2577-d3f1-46e2-956e-48bc8e03ec6a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:17.990514 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-4ebf2577-d3f1-46e2-956e-48bc8e03ec6a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:17.998535 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-4ebf2577-d3f1-46e2-956e-48bc8e03ec6a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.350374 Jun 27 15:36:17.999103 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 514/1025] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:17 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:19.015715 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-0f4960fd-7c7f-40d5-8c6a-0f4913aedc15 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:19.016469 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-0f4960fd-7c7f-40d5-8c6a-0f4913aedc15 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:19.024244 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f4960fd-7c7f-40d5-8c6a-0f4913aedc15 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:19.024718 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f4960fd-7c7f-40d5-8c6a-0f4913aedc15 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:19.025549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f4960fd-7c7f-40d5-8c6a-0f4913aedc15 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:19.025976 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-0f4960fd-7c7f-40d5-8c6a-0f4913aedc15 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:19.228690 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-0f4960fd-7c7f-40d5-8c6a-0f4913aedc15 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:19.240001 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-0f4960fd-7c7f-40d5-8c6a-0f4913aedc15 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.228094 Jun 27 15:36:19.240941 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 512/1026] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:19 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:20.264220 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f0c2f9ba-eb07-4561-bf43-ce00d2983bbf tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:20.264848 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f0c2f9ba-eb07-4561-bf43-ce00d2983bbf tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:20.273582 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f0c2f9ba-eb07-4561-bf43-ce00d2983bbf tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:20.274037 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f0c2f9ba-eb07-4561-bf43-ce00d2983bbf tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:20.274795 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f0c2f9ba-eb07-4561-bf43-ce00d2983bbf tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:20.275234 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f0c2f9ba-eb07-4561-bf43-ce00d2983bbf tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:20.294383 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=100 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:36:20.433889 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f0c2f9ba-eb07-4561-bf43-ce00d2983bbf tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:20.444363 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f0c2f9ba-eb07-4561-bf43-ce00d2983bbf tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.185137 Jun 27 15:36:20.444954 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 515/1027] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:20 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:21.464428 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-c7f20996-dcd7-44b1-b316-92b7a903cf83 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:21.465149 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-c7f20996-dcd7-44b1-b316-92b7a903cf83 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:21.474471 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7f20996-dcd7-44b1-b316-92b7a903cf83 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:21.475110 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7f20996-dcd7-44b1-b316-92b7a903cf83 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:21.476811 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7f20996-dcd7-44b1-b316-92b7a903cf83 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:21.477246 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-c7f20996-dcd7-44b1-b316-92b7a903cf83 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:21.621038 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-c7f20996-dcd7-44b1-b316-92b7a903cf83 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:21.632370 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-c7f20996-dcd7-44b1-b316-92b7a903cf83 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.173555 Jun 27 15:36:21.632846 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 513/1028] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:21 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:22.655705 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2772053f-b055-4e7e-93c7-1a18e8684b60 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:22.656495 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2772053f-b055-4e7e-93c7-1a18e8684b60 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:22.658756 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:36:22.665687 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2772053f-b055-4e7e-93c7-1a18e8684b60 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:22.666134 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2772053f-b055-4e7e-93c7-1a18e8684b60 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:22.666919 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2772053f-b055-4e7e-93c7-1a18e8684b60 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:22.667344 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2772053f-b055-4e7e-93c7-1a18e8684b60 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:22.813597 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2772053f-b055-4e7e-93c7-1a18e8684b60 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:22.823420 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2772053f-b055-4e7e-93c7-1a18e8684b60 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.171680 Jun 27 15:36:22.823968 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 516/1029] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:22 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:23.841151 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1fdd8d88-b603-4cf8-87ce-2fe07defadbd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:23.841794 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1fdd8d88-b603-4cf8-87ce-2fe07defadbd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:23.844173 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=43 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:36:23.849866 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fdd8d88-b603-4cf8-87ce-2fe07defadbd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:23.850314 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fdd8d88-b603-4cf8-87ce-2fe07defadbd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:23.851089 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fdd8d88-b603-4cf8-87ce-2fe07defadbd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:23.851878 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1fdd8d88-b603-4cf8-87ce-2fe07defadbd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:24.004957 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-1fdd8d88-b603-4cf8-87ce-2fe07defadbd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:24.013276 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1fdd8d88-b603-4cf8-87ce-2fe07defadbd tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.176078 Jun 27 15:36:24.013819 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 514/1030] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:23 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:25.090029 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-33913470-92d9-4cf7-8ab9-bda853997581 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:25.090587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-33913470-92d9-4cf7-8ab9-bda853997581 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:25.097780 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-33913470-92d9-4cf7-8ab9-bda853997581 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:25.098221 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-33913470-92d9-4cf7-8ab9-bda853997581 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:25.099007 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-33913470-92d9-4cf7-8ab9-bda853997581 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:25.099441 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-33913470-92d9-4cf7-8ab9-bda853997581 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:25.247016 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-33913470-92d9-4cf7-8ab9-bda853997581 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:25.260609 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-33913470-92d9-4cf7-8ab9-bda853997581 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.174238 Jun 27 15:36:25.261556 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 517/1031] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:25 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:26.286318 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dbdb0c77-e1fb-4bd1-88ee-68414814a524 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:26.287309 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dbdb0c77-e1fb-4bd1-88ee-68414814a524 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:26.299060 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbdb0c77-e1fb-4bd1-88ee-68414814a524 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:26.299658 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbdb0c77-e1fb-4bd1-88ee-68414814a524 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:26.300833 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbdb0c77-e1fb-4bd1-88ee-68414814a524 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:26.301453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dbdb0c77-e1fb-4bd1-88ee-68414814a524 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:26.453272 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dbdb0c77-e1fb-4bd1-88ee-68414814a524 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:26.465050 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dbdb0c77-e1fb-4bd1-88ee-68414814a524 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.184403 Jun 27 15:36:26.465843 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 515/1032] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:26 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:27.487967 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5da4e18f-532d-45b4-8ef4-d7406ace9d1d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:27.488634 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5da4e18f-532d-45b4-8ef4-d7406ace9d1d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:27.495685 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5da4e18f-532d-45b4-8ef4-d7406ace9d1d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:27.496138 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5da4e18f-532d-45b4-8ef4-d7406ace9d1d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:27.496929 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5da4e18f-532d-45b4-8ef4-d7406ace9d1d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:27.497367 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5da4e18f-532d-45b4-8ef4-d7406ace9d1d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:27.907828 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5da4e18f-532d-45b4-8ef4-d7406ace9d1d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:27.915619 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5da4e18f-532d-45b4-8ef4-d7406ace9d1d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.432215 Jun 27 15:36:27.916243 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 518/1033] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:27 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:28.934747 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e4b7f232-3829-462c-909b-d4dbcc3299a2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:28.935490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e4b7f232-3829-462c-909b-d4dbcc3299a2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:28.942420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4b7f232-3829-462c-909b-d4dbcc3299a2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:28.942864 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4b7f232-3829-462c-909b-d4dbcc3299a2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:28.943622 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4b7f232-3829-462c-909b-d4dbcc3299a2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:28.944049 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e4b7f232-3829-462c-909b-d4dbcc3299a2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:29.082817 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e4b7f232-3829-462c-909b-d4dbcc3299a2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:29.092273 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e4b7f232-3829-462c-909b-d4dbcc3299a2 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.163314 Jun 27 15:36:29.092877 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 516/1034] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:28 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:30.110433 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b601c8d0-5ff9-450b-af0e-f10afdf62e62 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:30.111032 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b601c8d0-5ff9-450b-af0e-f10afdf62e62 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:30.117934 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b601c8d0-5ff9-450b-af0e-f10afdf62e62 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:30.118383 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b601c8d0-5ff9-450b-af0e-f10afdf62e62 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:30.119206 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b601c8d0-5ff9-450b-af0e-f10afdf62e62 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:30.119697 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b601c8d0-5ff9-450b-af0e-f10afdf62e62 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:30.287195 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b601c8d0-5ff9-450b-af0e-f10afdf62e62 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:30.295271 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b601c8d0-5ff9-450b-af0e-f10afdf62e62 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.188753 Jun 27 15:36:30.295861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 519/1035] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:30 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:31.313487 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-fdac82d1-0792-4604-9cdc-e322fa440422 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:31.314108 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-fdac82d1-0792-4604-9cdc-e322fa440422 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:31.320749 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdac82d1-0792-4604-9cdc-e322fa440422 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:31.321211 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdac82d1-0792-4604-9cdc-e322fa440422 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:31.322054 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdac82d1-0792-4604-9cdc-e322fa440422 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:31.322490 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-fdac82d1-0792-4604-9cdc-e322fa440422 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:31.466599 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-fdac82d1-0792-4604-9cdc-e322fa440422 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:31.475509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-fdac82d1-0792-4604-9cdc-e322fa440422 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1511 microversion: 2.1 time: 0.166017 Jun 27 15:36:31.476085 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 517/1036] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:31 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:31.498072 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f6073c3e-b5ff-49cc-86c7-59b0f6839dd8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:36:31.498649 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f6073c3e-b5ff-49cc-86c7-59b0f6839dd8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:31.507021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f6073c3e-b5ff-49cc-86c7-59b0f6839dd8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:31.507640 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f6073c3e-b5ff-49cc-86c7-59b0f6839dd8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:31.508928 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f6073c3e-b5ff-49cc-86c7-59b0f6839dd8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:31.509579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f6073c3e-b5ff-49cc-86c7-59b0f6839dd8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:31.590988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f6073c3e-b5ff-49cc-86c7-59b0f6839dd8 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "POST /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31/action" status: 202 len: 0 microversion: 2.1 time: 0.099351 Jun 27 15:36:31.591707 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 520/1037] 10.222.0.26 () {60 vars in 1277 bytes} [Mon Jun 27 15:36:31 2022] POST /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:36:31.599963 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-719cd529-14a3-4e7d-9a4f-b3f32ba78b6d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:31.600715 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-719cd529-14a3-4e7d-9a4f-b3f32ba78b6d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:31.608003 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-719cd529-14a3-4e7d-9a4f-b3f32ba78b6d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:31.608452 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-719cd529-14a3-4e7d-9a4f-b3f32ba78b6d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:31.609365 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-719cd529-14a3-4e7d-9a4f-b3f32ba78b6d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:31.609796 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-719cd529-14a3-4e7d-9a4f-b3f32ba78b6d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:31.793323 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-719cd529-14a3-4e7d-9a4f-b3f32ba78b6d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:31.801392 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-719cd529-14a3-4e7d-9a4f-b3f32ba78b6d tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1519 microversion: 2.1 time: 0.205472 Jun 27 15:36:31.802001 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 518/1038] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:31 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1519 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:32.824006 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-84ad61ec-6b12-42a3-83bb-78e6e67130de tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:32.824653 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-84ad61ec-6b12-42a3-83bb-78e6e67130de tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:32.832515 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-84ad61ec-6b12-42a3-83bb-78e6e67130de tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:32.832970 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-84ad61ec-6b12-42a3-83bb-78e6e67130de tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:32.833741 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-84ad61ec-6b12-42a3-83bb-78e6e67130de tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:32.834194 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-84ad61ec-6b12-42a3-83bb-78e6e67130de tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:32.980209 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-84ad61ec-6b12-42a3-83bb-78e6e67130de tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:32.988416 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-84ad61ec-6b12-42a3-83bb-78e6e67130de tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1521 microversion: 2.1 time: 0.171838 Jun 27 15:36:32.988988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 521/1039] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:32 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:34.007679 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a0e21b4d-197b-4ce7-b840-c9d12a43d8b0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:34.008673 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a0e21b4d-197b-4ce7-b840-c9d12a43d8b0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:34.017691 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0e21b4d-197b-4ce7-b840-c9d12a43d8b0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:34.018424 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0e21b4d-197b-4ce7-b840-c9d12a43d8b0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:34.019495 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0e21b4d-197b-4ce7-b840-c9d12a43d8b0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:34.020207 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a0e21b4d-197b-4ce7-b840-c9d12a43d8b0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:34.173277 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a0e21b4d-197b-4ce7-b840-c9d12a43d8b0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:34.181707 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a0e21b4d-197b-4ce7-b840-c9d12a43d8b0 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1577 microversion: 2.1 time: 0.178843 Jun 27 15:36:34.182284 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 519/1040] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:34 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1577 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:35.201918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a9fded38-9be9-421f-946b-090ec5622d01 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:35.202508 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a9fded38-9be9-421f-946b-090ec5622d01 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:35.209654 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a9fded38-9be9-421f-946b-090ec5622d01 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:35.210099 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a9fded38-9be9-421f-946b-090ec5622d01 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:35.210862 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a9fded38-9be9-421f-946b-090ec5622d01 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:35.211283 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a9fded38-9be9-421f-946b-090ec5622d01 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:35.363257 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-a9fded38-9be9-421f-946b-090ec5622d01 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:35.371624 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a9fded38-9be9-421f-946b-090ec5622d01 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1577 microversion: 2.1 time: 0.175270 Jun 27 15:36:35.372195 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 522/1041] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:35 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1577 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:35.826954 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-c679aece-0758-42ea-af8d-6b28cd278d55 req-ed3d2a82-f1a3-4d86-94dc-990d8a84faf9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d3f4f1-4158-4a2f-8568-5cea794cdf31", "name": "network-vif-unplugged", "status": "completed", "tag": "8a6da410-e6d2-40db-ac82-63f37c7545e0"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:36:35.836455 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-c679aece-0758-42ea-af8d-6b28cd278d55 req-ed3d2a82-f1a3-4d86-94dc-990d8a84faf9 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:35.836947 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-c679aece-0758-42ea-af8d-6b28cd278d55 req-ed3d2a82-f1a3-4d86-94dc-990d8a84faf9 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:35.850064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-c679aece-0758-42ea-af8d-6b28cd278d55 req-ed3d2a82-f1a3-4d86-94dc-990d8a84faf9 service nova] Creating event network-vif-unplugged:8a6da410-e6d2-40db-ac82-63f37c7545e0 for instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 on hv-cinder-84779 Jun 27 15:36:35.855315 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-c679aece-0758-42ea-af8d-6b28cd278d55 req-ed3d2a82-f1a3-4d86-94dc-990d8a84faf9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032401 Jun 27 15:36:35.856069 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 520/1042] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:36:35 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:36:36.388747 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f9f1d188-6ee6-4e69-8766-b6c279ee3849 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:36.389334 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f9f1d188-6ee6-4e69-8766-b6c279ee3849 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:36.396283 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f9f1d188-6ee6-4e69-8766-b6c279ee3849 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:36.396785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f9f1d188-6ee6-4e69-8766-b6c279ee3849 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:36.397546 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f9f1d188-6ee6-4e69-8766-b6c279ee3849 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:36.397982 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f9f1d188-6ee6-4e69-8766-b6c279ee3849 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:36.532142 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f9f1d188-6ee6-4e69-8766-b6c279ee3849 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:36.540536 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f9f1d188-6ee6-4e69-8766-b6c279ee3849 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1577 microversion: 2.1 time: 0.155747 Jun 27 15:36:36.541147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 523/1043] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:36 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1577 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:37.560662 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-30184e2a-e634-4722-811b-6b61847dbf93 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:37.561362 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-30184e2a-e634-4722-811b-6b61847dbf93 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:37.568505 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30184e2a-e634-4722-811b-6b61847dbf93 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:37.568951 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30184e2a-e634-4722-811b-6b61847dbf93 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:37.569708 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30184e2a-e634-4722-811b-6b61847dbf93 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:37.570137 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-30184e2a-e634-4722-811b-6b61847dbf93 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:37.710391 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-30184e2a-e634-4722-811b-6b61847dbf93 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:37.719939 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-30184e2a-e634-4722-811b-6b61847dbf93 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1577 microversion: 2.1 time: 0.164602 Jun 27 15:36:37.720533 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 521/1044] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:37 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1577 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:38.738530 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3022206e-37a2-4859-81c0-757d9404143e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:38.739282 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3022206e-37a2-4859-81c0-757d9404143e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:38.747683 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3022206e-37a2-4859-81c0-757d9404143e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:38.748176 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3022206e-37a2-4859-81c0-757d9404143e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:38.749071 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3022206e-37a2-4859-81c0-757d9404143e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:38.749564 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3022206e-37a2-4859-81c0-757d9404143e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:38.892360 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3022206e-37a2-4859-81c0-757d9404143e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:38.900472 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3022206e-37a2-4859-81c0-757d9404143e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1577 microversion: 2.1 time: 0.166541 Jun 27 15:36:38.901031 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 524/1045] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:38 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1577 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:39.923017 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e630928c-4a88-48cc-8661-5214776e894e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:39.923661 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e630928c-4a88-48cc-8661-5214776e894e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:39.931305 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e630928c-4a88-48cc-8661-5214776e894e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:39.931752 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e630928c-4a88-48cc-8661-5214776e894e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:39.932534 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e630928c-4a88-48cc-8661-5214776e894e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:39.934281 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e630928c-4a88-48cc-8661-5214776e894e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:40.074053 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e630928c-4a88-48cc-8661-5214776e894e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:40.082028 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e630928c-4a88-48cc-8661-5214776e894e tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1577 microversion: 2.1 time: 0.163549 Jun 27 15:36:40.082602 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 522/1046] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:39 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1577 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:41.100280 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-294aec72-fb47-406b-901d-2454b0f90aef tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:36:41.100928 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-294aec72-fb47-406b-901d-2454b0f90aef tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:36:41.109874 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-294aec72-fb47-406b-901d-2454b0f90aef tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:41.110320 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-294aec72-fb47-406b-901d-2454b0f90aef tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:41.111352 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-294aec72-fb47-406b-901d-2454b0f90aef tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:41.111791 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-294aec72-fb47-406b-901d-2454b0f90aef tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:41.262695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-294aec72-fb47-406b-901d-2454b0f90aef tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:36:41.270560 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-294aec72-fb47-406b-901d-2454b0f90aef tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1564 microversion: 2.1 time: 0.174888 Jun 27 15:36:41.271097 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 525/1047] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:36:41 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1564 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:36:43.928888 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-edfc649c-9a4e-45ce-a405-3ac87b75962f req-75227e2b-b723-4b5b-a1f0-c58fde7a8031 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d3f4f1-4158-4a2f-8568-5cea794cdf31", "name": "network-vif-plugged", "status": "completed", "tag": "8a6da410-e6d2-40db-ac82-63f37c7545e0"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:36:43.938596 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-edfc649c-9a4e-45ce-a405-3ac87b75962f req-75227e2b-b723-4b5b-a1f0-c58fde7a8031 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:36:43.939060 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-edfc649c-9a4e-45ce-a405-3ac87b75962f req-75227e2b-b723-4b5b-a1f0-c58fde7a8031 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:36:43.952042 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-edfc649c-9a4e-45ce-a405-3ac87b75962f req-75227e2b-b723-4b5b-a1f0-c58fde7a8031 service nova] Creating event network-vif-plugged:8a6da410-e6d2-40db-ac82-63f37c7545e0 for instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 on hv-cinder-84779 Jun 27 15:36:43.957078 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-edfc649c-9a4e-45ce-a405-3ac87b75962f req-75227e2b-b723-4b5b-a1f0-c58fde7a8031 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031881 Jun 27 15:36:43.957764 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 523/1048] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:37:55.643174 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=21 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:37:55.645522 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:37:55.645830 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=19 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:37:55.647095 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=74 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:37:55.650784 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-fa84eb73-978a-4082-8f50-37b1e7676070 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:37:55.651774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-fa84eb73-978a-4082-8f50-37b1e7676070 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:37:55.659499 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa84eb73-978a-4082-8f50-37b1e7676070 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:55.659953 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa84eb73-978a-4082-8f50-37b1e7676070 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:55.660752 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa84eb73-978a-4082-8f50-37b1e7676070 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:55.661189 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-fa84eb73-978a-4082-8f50-37b1e7676070 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:55.690588 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-fa84eb73-978a-4082-8f50-37b1e7676070 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Going to try to terminate instance {{(pid=117977) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:37:55.721299 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-5fd1dbb2-bbd1-44c2-9998-6345d89b60fc req-d7345cbd-1737-4f41-9340-fce4d2b43452 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e7d3f4f1-4158-4a2f-8568-5cea794cdf31", "tag": "8a6da410-e6d2-40db-ac82-63f37c7545e0"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:37:55.732139 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-5fd1dbb2-bbd1-44c2-9998-6345d89b60fc req-d7345cbd-1737-4f41-9340-fce4d2b43452 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:55.732748 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-5fd1dbb2-bbd1-44c2-9998-6345d89b60fc req-d7345cbd-1737-4f41-9340-fce4d2b43452 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:55.745798 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-5fd1dbb2-bbd1-44c2-9998-6345d89b60fc req-d7345cbd-1737-4f41-9340-fce4d2b43452 service nova] Creating event network-changed:8a6da410-e6d2-40db-ac82-63f37c7545e0 for instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 on hv-cinder-84779 Jun 27 15:37:55.751537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-5fd1dbb2-bbd1-44c2-9998-6345d89b60fc req-d7345cbd-1737-4f41-9340-fce4d2b43452 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107987 Jun 27 15:37:55.755514 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 524/1049] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:37:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:37:55.773180 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-fa84eb73-978a-4082-8f50-37b1e7676070 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 204 len: 0 microversion: 2.1 time: 0.131755 Jun 27 15:37:55.778111 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 526/1050] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:37:55 2022] DELETE /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:37:55.787634 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-276f7450-847f-467a-a071-2408f41f1280 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:37:55.788443 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-276f7450-847f-467a-a071-2408f41f1280 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:37:55.796342 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-276f7450-847f-467a-a071-2408f41f1280 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:55.796797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-276f7450-847f-467a-a071-2408f41f1280 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:55.797568 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-276f7450-847f-467a-a071-2408f41f1280 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:55.798002 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-276f7450-847f-467a-a071-2408f41f1280 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:55.941019 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-276f7450-847f-467a-a071-2408f41f1280 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:37:55.949328 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-276f7450-847f-467a-a071-2408f41f1280 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.169562 Jun 27 15:37:55.949948 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 525/1051] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:37:55 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:37:56.970255 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b8b8594d-043e-42e0-abdb-b8994149fb47 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:37:56.970861 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b8b8594d-043e-42e0-abdb-b8994149fb47 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:37:56.980378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8b8594d-043e-42e0-abdb-b8994149fb47 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:56.980849 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8b8594d-043e-42e0-abdb-b8994149fb47 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:56.981622 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8b8594d-043e-42e0-abdb-b8994149fb47 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:56.982046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b8b8594d-043e-42e0-abdb-b8994149fb47 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:57.143912 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b8b8594d-043e-42e0-abdb-b8994149fb47 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:37:57.152276 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b8b8594d-043e-42e0-abdb-b8994149fb47 tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1570 microversion: 2.1 time: 0.188394 Jun 27 15:37:57.152900 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 527/1052] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:37:56 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1570 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:37:57.815723 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-332f0bb6-7e79-4a83-8455-b4251862c32a req-b9e43fca-0240-4e4e-981e-825ff3da15de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e7d3f4f1-4158-4a2f-8568-5cea794cdf31", "name": "network-vif-deleted", "tag": "8a6da410-e6d2-40db-ac82-63f37c7545e0"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:37:57.824639 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-332f0bb6-7e79-4a83-8455-b4251862c32a req-b9e43fca-0240-4e4e-981e-825ff3da15de service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:57.825062 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-332f0bb6-7e79-4a83-8455-b4251862c32a req-b9e43fca-0240-4e4e-981e-825ff3da15de service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:57.835902 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-332f0bb6-7e79-4a83-8455-b4251862c32a req-b9e43fca-0240-4e4e-981e-825ff3da15de service nova] Creating event network-vif-deleted:8a6da410-e6d2-40db-ac82-63f37c7545e0 for instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 on hv-cinder-84779 Jun 27 15:37:57.841926 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-332f0bb6-7e79-4a83-8455-b4251862c32a req-b9e43fca-0240-4e4e-981e-825ff3da15de service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089501 Jun 27 15:37:57.842826 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 526/1053] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:37:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:37:58.170584 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:37:58.171333 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:37:58.178538 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:58.178988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:58.179797 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:58.180297 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:58.218213 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:58.218664 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:58.219120 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lazy-loading 'fault' on Instance uuid e7d3f4f1-4158-4a2f-8568-5cea794cdf31 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:37:58.264950 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b35218bf5d284771b5107601ec633f7c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9954040eb98d4ecdafbc681132689ff5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:37:58.273905 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ee9f747c-9cb0-4850-bf3f-798b12c71d7a tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 200 len: 1224 microversion: 2.1 time: 0.107036 Jun 27 15:37:58.274430 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 528/1054] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:37:58 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 1224 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:37:59.293405 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6e275e94-627d-4e23-8329-4232052e11dc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:37:59.294085 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6e275e94-627d-4e23-8329-4232052e11dc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] [instance: e7d3f4f1-4158-4a2f-8568-5cea794cdf31] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:37:59.300973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e275e94-627d-4e23-8329-4232052e11dc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:59.301431 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e275e94-627d-4e23-8329-4232052e11dc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:59.302202 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e275e94-627d-4e23-8329-4232052e11dc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:37:59.302641 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6e275e94-627d-4e23-8329-4232052e11dc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:37:59.316659 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-6e275e94-627d-4e23-8329-4232052e11dc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] HTTP exception thrown: Instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 could not be found. Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6e275e94-627d-4e23-8329-4232052e11dc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Request method failure captured: Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 HTTP/1.1 Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiuc23ywDDOoxRMLdKd75lRyXiHezZpa3_NadsUFdpkF8ZbYkd899ge5Bbmqy4YeGdj82agiQ1cNrrxinzQpExWRoZreYGaYdXCVKR4ByMHw3gz04GBdkHg9Qc166N4X1CHaxcJL81AV2XD3WLeasMzj59CHwyAKvc09bZQM5pa65qkRE Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: 9954040eb98d4ecdafbc681132689ff5 Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-TestShelveInstance-1025972585 Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:37:59.318317 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_9954040eb98d4ecdafbc681132689ff5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/9954040eb98d4ecdafbc681132689ff5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9954040eb98d4ecdafbc681132689ff5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/9954040eb98d4ecdafbc681132689ff5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-TestShelveInstance-1025972585 Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: 9954040eb98d4ecdafbc681132689ff5 Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-TestShelveInstance-1025972585 Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-TestShelveInstance-1025972585-project Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: b35218bf5d284771b5107601ec633f7c Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-TestShelveInstance-1025972585-project Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 could not be found. Jun 27 15:37:59.320142 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': 'e7d3f4f1-4158-4a2f-8568-5cea794cdf31'} Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 could not be found. Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:37:59.321209 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 could not be found. Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 could not be found. Jun 27 15:37:59.322879 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:37:59.324250 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6e275e94-627d-4e23-8329-4232052e11dc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Returning 404 to user: Instance e7d3f4f1-4158-4a2f-8568-5cea794cdf31 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:37:59.324250 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6e275e94-627d-4e23-8329-4232052e11dc tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31" status: 404 len: 111 microversion: 2.1 time: 0.031245 Jun 27 15:37:59.324250 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 527/1055] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:37:59 2022] GET /compute/v2.1/servers/e7d3f4f1-4158-4a2f-8568-5cea794cdf31 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:37:59.509163 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-d6f4259f-3c2d-4f27-9146-c699eeb7175c tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] Calling method '.version_select at 0x7fb273449280>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:37:59.531571 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-d6f4259f-3c2d-4f27-9146-c699eeb7175c tempest-TestShelveInstance-1025972585 tempest-TestShelveInstance-1025972585-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1394865336" status: 202 len: 0 microversion: 2.1 time: 0.026282 Jun 27 15:37:59.532636 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 529/1056] 10.222.0.26 () {58 vars in 1253 bytes} [Mon Jun 27 15:37:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1394865336 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 15:38:11.301825 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-de07e7ae-163f-46c7-b9df-03cc7aa52388 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:11.302656 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-de07e7ae-163f-46c7-b9df-03cc7aa52388 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:11.305925 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=8 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:38:11.306722 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=12 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:38:11.315076 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de07e7ae-163f-46c7-b9df-03cc7aa52388 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:11.315531 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de07e7ae-163f-46c7-b9df-03cc7aa52388 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:11.316335 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de07e7ae-163f-46c7-b9df-03cc7aa52388 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:11.316780 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-de07e7ae-163f-46c7-b9df-03cc7aa52388 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:11.345586 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-de07e7ae-163f-46c7-b9df-03cc7aa52388 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Going to try to terminate instance {{(pid=117978) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:38:11.427441 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-de07e7ae-163f-46c7-b9df-03cc7aa52388 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 204 len: 0 microversion: 2.1 time: 0.131802 Jun 27 15:38:11.428286 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 528/1057] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:38:11 2022] DELETE /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:38:11.434203 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=28,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:38:11.434949 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:38:11.438958 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5e926a06-62ff-4820-8616-e813551a43f6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:11.439575 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5e926a06-62ff-4820-8616-e813551a43f6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:11.448630 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5e926a06-62ff-4820-8616-e813551a43f6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:11.449055 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5e926a06-62ff-4820-8616-e813551a43f6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:11.449827 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5e926a06-62ff-4820-8616-e813551a43f6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:11.450253 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5e926a06-62ff-4820-8616-e813551a43f6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:11.600293 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5e926a06-62ff-4820-8616-e813551a43f6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:11.611199 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5e926a06-62ff-4820-8616-e813551a43f6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1576 microversion: 2.1 time: 0.178503 Jun 27 15:38:11.611766 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 530/1058] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:11 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:12.629906 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-e3c131cf-a4eb-43c7-9b29-f79de3a7ba70 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:12.630576 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-e3c131cf-a4eb-43c7-9b29-f79de3a7ba70 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:12.637567 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c131cf-a4eb-43c7-9b29-f79de3a7ba70 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:12.638016 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c131cf-a4eb-43c7-9b29-f79de3a7ba70 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:12.638776 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c131cf-a4eb-43c7-9b29-f79de3a7ba70 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:12.639204 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-e3c131cf-a4eb-43c7-9b29-f79de3a7ba70 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:12.776896 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-e3c131cf-a4eb-43c7-9b29-f79de3a7ba70 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:12.785299 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-e3c131cf-a4eb-43c7-9b29-f79de3a7ba70 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1576 microversion: 2.1 time: 0.160199 Jun 27 15:38:12.785795 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 529/1059] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:12 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:13.803567 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5da78b74-a91a-44e2-93a6-847f24a32383 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:13.804134 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5da78b74-a91a-44e2-93a6-847f24a32383 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:13.811377 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5da78b74-a91a-44e2-93a6-847f24a32383 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:13.811823 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5da78b74-a91a-44e2-93a6-847f24a32383 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:13.812636 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5da78b74-a91a-44e2-93a6-847f24a32383 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:13.813067 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5da78b74-a91a-44e2-93a6-847f24a32383 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:13.892421 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5da78b74-a91a-44e2-93a6-847f24a32383 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:13.901045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5da78b74-a91a-44e2-93a6-847f24a32383 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 200 len: 1508 microversion: 2.1 time: 0.101947 Jun 27 15:38:13.902191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 531/1060] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:13 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 1508 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:14.050973 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-8572e772-d2c6-4763-9b16-0748a3b7868c req-071039fa-5bd3-4f69-b314-71fff7bb38f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c64daf70-81db-49be-8de8-4900c3f76376", "name": "network-vif-deleted", "tag": "47374d7b-7e06-44d7-a9da-7f84a58ae0aa"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:38:14.068945 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-8572e772-d2c6-4763-9b16-0748a3b7868c req-071039fa-5bd3-4f69-b314-71fff7bb38f3 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:14.069898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-8572e772-d2c6-4763-9b16-0748a3b7868c req-071039fa-5bd3-4f69-b314-71fff7bb38f3 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:14.086311 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-8572e772-d2c6-4763-9b16-0748a3b7868c req-071039fa-5bd3-4f69-b314-71fff7bb38f3 service nova] Creating event network-vif-deleted:47374d7b-7e06-44d7-a9da-7f84a58ae0aa for instance c64daf70-81db-49be-8de8-4900c3f76376 on hv-cinder-84779 Jun 27 15:38:14.091837 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-8572e772-d2c6-4763-9b16-0748a3b7868c req-071039fa-5bd3-4f69-b314-71fff7bb38f3 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044921 Jun 27 15:38:14.092898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 530/1061] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:38:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:38:14.919749 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-55ad6bec-6e75-4ade-bc35-a368a43de539 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:14.920347 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-55ad6bec-6e75-4ade-bc35-a368a43de539 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:14.928201 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-55ad6bec-6e75-4ade-bc35-a368a43de539 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:14.928680 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-55ad6bec-6e75-4ade-bc35-a368a43de539 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:14.929466 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-55ad6bec-6e75-4ade-bc35-a368a43de539 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:14.929964 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-55ad6bec-6e75-4ade-bc35-a368a43de539 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:14.944774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-55ad6bec-6e75-4ade-bc35-a368a43de539 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] HTTP exception thrown: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-55ad6bec-6e75-4ade-bc35-a368a43de539 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Request method failure captured: Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 HTTP/1.1 Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiuc49LaC3CfqiDNUcEhMMEiDes_vu4itqAxygHbtT1STdwMsPJKgNPmcH3UPPsGojANdAp4t8GgQtvfI-v-Sxeeq4vvvWHQeT0XMDIf1JrQb1knVT7RjoKMM_pjeq3ch6XEC8KP36PKyU13CnCxbWacU4yszvzfmwNI2fnKh4a5NjS8s Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: bf83328eefb741d086f33cd650fd3942 Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-TestVolumeBootPattern-442144854 Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:38:14.946462 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bf83328eefb741d086f33cd650fd3942", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-TestVolumeBootPattern-442144854 Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: bf83328eefb741d086f33cd650fd3942 Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-TestVolumeBootPattern-442144854 Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-TestVolumeBootPattern-442144854-project Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 6401f2aaa0af4708953b42863aa25de0 Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-TestVolumeBootPattern-442144854-project Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:38:14.948147 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'c64daf70-81db-49be-8de8-4900c3f76376'} Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:38:14.949132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:38:14.950425 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:38:14.951549 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-55ad6bec-6e75-4ade-bc35-a368a43de539 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Returning 404 to user: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:38:14.951549 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-55ad6bec-6e75-4ade-bc35-a368a43de539 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 404 len: 111 microversion: 2.1 time: 0.032181 Jun 27 15:38:14.951549 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 532/1062] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:14 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:38:15.056850 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-629797378", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-739718795", "security_groups": [{"name": "tempest-secgroup-smoke-1949080385"}], "block_device_mapping_v2": [{"uuid": "edadf0b1-9751-4caa-ac9f-f4f7f2c967d8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09bbc698-5eb1-420c-a302-7f9a1544cd53"}]}} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:38:15.178421 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.network.neutron [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] validate_networks() for [('09bbc698-5eb1-420c-a302-7f9a1544cd53', None, None, None, None, None)] {{(pid=117978) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:38:15.683628 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Flavor limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:38:15.684376 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Image limits 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:38:15.685134 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Flavor pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:38:15.685812 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Image pref 0:0:0 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:38:15.686509 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.virt.hardware [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117978) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:38:15.697382 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:15.697835 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:15.698629 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:15.699069 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:15.716157 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Getting quotas for project bf83328eefb741d086f33cd650fd3942. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:38:15.720288 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.quota [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Getting quotas for user 6401f2aaa0af4708953b42863aa25de0 and project bf83328eefb741d086f33cd650fd3942. Resources: {'ram', 'instances', 'cores'} {{(pid=117978) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:38:15.782448 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Going to run 1 instances... {{(pid=117978) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:38:15.784991 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='edadf0b1-9751-4caa-ac9f-f4f7f2c967d8',volume_size=None,volume_type=None)] {{(pid=117978) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:38:15.916221 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [ed426bf8-2fa0-4605-8a20-fa4209e890a2] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 27 15:38:16.927146 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [ed426bf8-2fa0-4605-8a20-fa4209e890a2] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53310. Jun 27 15:38:16.933328 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-6452a3a7-95b3-45c1-a653-0b30fe7943e2 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.880956 Jun 27 15:38:16.934449 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 531/1063] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:38:15 2022] POST /compute/v2.1/servers => generated 406 bytes in 1883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 15:38:16.944595 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-69952d37-3ceb-493c-98ee-94b9a7a360dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:16.945188 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-69952d37-3ceb-493c-98ee-94b9a7a360dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:17.009869 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-69952d37-3ceb-493c-98ee-94b9a7a360dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:17.020120 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-69952d37-3ceb-493c-98ee-94b9a7a360dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1093 microversion: 2.1 time: 0.079584 Jun 27 15:38:17.020719 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 533/1064] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:16 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1093 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:18.038049 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-122cc2d6-3e66-4007-946e-469686088804 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:18.038683 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-122cc2d6-3e66-4007-946e-469686088804 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:18.045447 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-122cc2d6-3e66-4007-946e-469686088804 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:18.046318 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-122cc2d6-3e66-4007-946e-469686088804 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:18.047109 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-122cc2d6-3e66-4007-946e-469686088804 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:18.047554 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-122cc2d6-3e66-4007-946e-469686088804 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:18.131479 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-122cc2d6-3e66-4007-946e-469686088804 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:18.140721 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-122cc2d6-3e66-4007-946e-469686088804 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1199 microversion: 2.1 time: 0.107111 Jun 27 15:38:18.141315 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 532/1065] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:18 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1199 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:19.160567 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-bde3a593-544c-457c-984d-660d5ba35eed tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:19.161340 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-bde3a593-544c-457c-984d-660d5ba35eed tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:19.167820 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bde3a593-544c-457c-984d-660d5ba35eed tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:19.168656 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bde3a593-544c-457c-984d-660d5ba35eed tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:19.169502 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bde3a593-544c-457c-984d-660d5ba35eed tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:19.170191 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-bde3a593-544c-457c-984d-660d5ba35eed tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:19.321329 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-bde3a593-544c-457c-984d-660d5ba35eed tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:19.331816 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-bde3a593-544c-457c-984d-660d5ba35eed tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.176259 Jun 27 15:38:19.333166 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 534/1066] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:19 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:19.465743 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-029c1f1c-91ff-408b-8fcf-f713a287bda9 req-0470c9f1-e42d-4903-9d79-139f3e5747f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3997d0-c146-403f-9249-e9c457819d36", "tag": "928d1e85-bf47-4f29-9eb6-61c0816e3e03"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:38:19.477383 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-029c1f1c-91ff-408b-8fcf-f713a287bda9 req-0470c9f1-e42d-4903-9d79-139f3e5747f5 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:19.477747 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-029c1f1c-91ff-408b-8fcf-f713a287bda9 req-0470c9f1-e42d-4903-9d79-139f3e5747f5 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:19.503447 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-029c1f1c-91ff-408b-8fcf-f713a287bda9 req-0470c9f1-e42d-4903-9d79-139f3e5747f5 service nova] Creating event network-changed:928d1e85-bf47-4f29-9eb6-61c0816e3e03 for instance ab3997d0-c146-403f-9249-e9c457819d36 on hv-cinder-84779 Jun 27 15:38:19.509575 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-029c1f1c-91ff-408b-8fcf-f713a287bda9 req-0470c9f1-e42d-4903-9d79-139f3e5747f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047454 Jun 27 15:38:19.510599 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 533/1067] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:38:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:38:20.350359 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9143e1a3-7e68-4966-b61e-5fbf9ef81ffb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:20.351047 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9143e1a3-7e68-4966-b61e-5fbf9ef81ffb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:20.359676 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9143e1a3-7e68-4966-b61e-5fbf9ef81ffb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:20.360201 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9143e1a3-7e68-4966-b61e-5fbf9ef81ffb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:20.361058 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9143e1a3-7e68-4966-b61e-5fbf9ef81ffb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:20.361552 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9143e1a3-7e68-4966-b61e-5fbf9ef81ffb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:20.509300 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9143e1a3-7e68-4966-b61e-5fbf9ef81ffb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:20.517940 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9143e1a3-7e68-4966-b61e-5fbf9ef81ffb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.172372 Jun 27 15:38:20.518490 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 535/1068] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:20 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:21.537544 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2d21d055-5bbf-452d-8432-18a29342b6ea tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:21.538282 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2d21d055-5bbf-452d-8432-18a29342b6ea tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:21.545562 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2d21d055-5bbf-452d-8432-18a29342b6ea tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:21.546005 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2d21d055-5bbf-452d-8432-18a29342b6ea tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:21.546771 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2d21d055-5bbf-452d-8432-18a29342b6ea tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:21.547201 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-2d21d055-5bbf-452d-8432-18a29342b6ea tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:21.698580 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2d21d055-5bbf-452d-8432-18a29342b6ea tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:21.707288 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2d21d055-5bbf-452d-8432-18a29342b6ea tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.174789 Jun 27 15:38:21.707667 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 534/1069] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:21 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:22.725517 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-443f6568-2602-45b3-b7a7-914c372e0c5a tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:22.726157 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-443f6568-2602-45b3-b7a7-914c372e0c5a tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:22.733562 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-443f6568-2602-45b3-b7a7-914c372e0c5a tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:22.734046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-443f6568-2602-45b3-b7a7-914c372e0c5a tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:22.734906 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-443f6568-2602-45b3-b7a7-914c372e0c5a tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:22.735368 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-443f6568-2602-45b3-b7a7-914c372e0c5a tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:22.873246 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-443f6568-2602-45b3-b7a7-914c372e0c5a tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:22.882074 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-443f6568-2602-45b3-b7a7-914c372e0c5a tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.161532 Jun 27 15:38:22.882635 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 536/1070] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:22 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:23.899748 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-394ce3f9-80d7-4df3-8396-75bebb80e7dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:23.900306 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-394ce3f9-80d7-4df3-8396-75bebb80e7dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:23.907284 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-394ce3f9-80d7-4df3-8396-75bebb80e7dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:23.907728 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-394ce3f9-80d7-4df3-8396-75bebb80e7dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:23.908521 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-394ce3f9-80d7-4df3-8396-75bebb80e7dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:23.908951 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-394ce3f9-80d7-4df3-8396-75bebb80e7dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:24.058819 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-394ce3f9-80d7-4df3-8396-75bebb80e7dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:24.067124 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-394ce3f9-80d7-4df3-8396-75bebb80e7dd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.171252 Jun 27 15:38:24.067695 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 535/1071] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:23 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:24.884549 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:38:24.884734 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Mon Jun 27 15:38:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:38:25.090533 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-e89ca54c-9577-4727-95dc-e9206428804c tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:25.091159 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-e89ca54c-9577-4727-95dc-e9206428804c tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:25.099589 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e89ca54c-9577-4727-95dc-e9206428804c tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:25.100033 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e89ca54c-9577-4727-95dc-e9206428804c tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:25.100835 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e89ca54c-9577-4727-95dc-e9206428804c tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:25.101263 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-e89ca54c-9577-4727-95dc-e9206428804c tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:25.260997 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-e89ca54c-9577-4727-95dc-e9206428804c tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:25.269109 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-e89ca54c-9577-4727-95dc-e9206428804c tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.183147 Jun 27 15:38:25.269759 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 537/1072] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:25 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:26.285629 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-328b3536-3023-4dcc-9f02-88db08f7e1e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:26.286233 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-328b3536-3023-4dcc-9f02-88db08f7e1e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:26.289068 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:38:26.289773 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=6 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:38:26.295898 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-328b3536-3023-4dcc-9f02-88db08f7e1e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:26.296346 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-328b3536-3023-4dcc-9f02-88db08f7e1e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:26.297151 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-328b3536-3023-4dcc-9f02-88db08f7e1e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:26.297567 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-328b3536-3023-4dcc-9f02-88db08f7e1e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:26.456303 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-328b3536-3023-4dcc-9f02-88db08f7e1e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:26.464597 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-328b3536-3023-4dcc-9f02-88db08f7e1e0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.182825 Jun 27 15:38:26.465150 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 536/1073] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:26 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:27.481099 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-268c1c71-f179-476a-a09f-8b8981a981f5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:27.481683 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-268c1c71-f179-476a-a09f-8b8981a981f5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:27.484000 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:38:27.489696 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-268c1c71-f179-476a-a09f-8b8981a981f5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:27.490307 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-268c1c71-f179-476a-a09f-8b8981a981f5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:27.491510 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-268c1c71-f179-476a-a09f-8b8981a981f5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:27.491975 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-268c1c71-f179-476a-a09f-8b8981a981f5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:27.636351 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-268c1c71-f179-476a-a09f-8b8981a981f5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:27.644449 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-268c1c71-f179-476a-a09f-8b8981a981f5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.167221 Jun 27 15:38:27.645014 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 538/1074] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:27 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:28.661645 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4c382a60-328c-4661-9203-d50f6b5d1e27 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:28.662211 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4c382a60-328c-4661-9203-d50f6b5d1e27 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:28.669813 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c382a60-328c-4661-9203-d50f6b5d1e27 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:28.670271 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c382a60-328c-4661-9203-d50f6b5d1e27 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:28.671064 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c382a60-328c-4661-9203-d50f6b5d1e27 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:28.671500 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4c382a60-328c-4661-9203-d50f6b5d1e27 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:28.810665 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4c382a60-328c-4661-9203-d50f6b5d1e27 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:28.818755 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4c382a60-328c-4661-9203-d50f6b5d1e27 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.161056 Jun 27 15:38:28.819479 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 537/1075] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:28 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:29.836221 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-651dc349-c3e9-4feb-94c0-ed0aba360945 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:29.836875 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-651dc349-c3e9-4feb-94c0-ed0aba360945 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:29.843739 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-651dc349-c3e9-4feb-94c0-ed0aba360945 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:29.844183 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-651dc349-c3e9-4feb-94c0-ed0aba360945 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:29.844980 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-651dc349-c3e9-4feb-94c0-ed0aba360945 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:29.845411 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-651dc349-c3e9-4feb-94c0-ed0aba360945 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:29.998892 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-651dc349-c3e9-4feb-94c0-ed0aba360945 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:30.010676 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-651dc349-c3e9-4feb-94c0-ed0aba360945 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.178847 Jun 27 15:38:30.011526 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 539/1076] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:29 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:30.447903 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-a93abe53-bb04-48a2-bbf8-e3e682e7bc2f req-297d9f64-2b04-430e-9e67-040df4e36c39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3997d0-c146-403f-9249-e9c457819d36", "name": "network-vif-plugged", "status": "completed", "tag": "928d1e85-bf47-4f29-9eb6-61c0816e3e03"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:38:30.456156 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a93abe53-bb04-48a2-bbf8-e3e682e7bc2f req-297d9f64-2b04-430e-9e67-040df4e36c39 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:30.456613 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-a93abe53-bb04-48a2-bbf8-e3e682e7bc2f req-297d9f64-2b04-430e-9e67-040df4e36c39 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:30.467994 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-a93abe53-bb04-48a2-bbf8-e3e682e7bc2f req-297d9f64-2b04-430e-9e67-040df4e36c39 service nova] Creating event network-vif-plugged:928d1e85-bf47-4f29-9eb6-61c0816e3e03 for instance ab3997d0-c146-403f-9249-e9c457819d36 on hv-cinder-84779 Jun 27 15:38:30.473302 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-a93abe53-bb04-48a2-bbf8-e3e682e7bc2f req-297d9f64-2b04-430e-9e67-040df4e36c39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.159246 Jun 27 15:38:30.473869 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 538/1077] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:38:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:38:31.027745 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-728ddf35-4757-447c-aadf-28e38775387f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:31.028397 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-728ddf35-4757-447c-aadf-28e38775387f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:31.035303 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-728ddf35-4757-447c-aadf-28e38775387f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:31.035747 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-728ddf35-4757-447c-aadf-28e38775387f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:31.036560 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-728ddf35-4757-447c-aadf-28e38775387f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:31.036990 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-728ddf35-4757-447c-aadf-28e38775387f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:31.202085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-728ddf35-4757-447c-aadf-28e38775387f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:31.212903 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-728ddf35-4757-447c-aadf-28e38775387f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1265 microversion: 2.1 time: 0.189635 Jun 27 15:38:31.213470 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 540/1078] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:31 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:32.232015 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-d3015210-7f79-4c27-b2f7-d1bf705329a0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:32.232628 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-d3015210-7f79-4c27-b2f7-d1bf705329a0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:32.239626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d3015210-7f79-4c27-b2f7-d1bf705329a0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:32.240071 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d3015210-7f79-4c27-b2f7-d1bf705329a0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:32.240890 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d3015210-7f79-4c27-b2f7-d1bf705329a0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:32.241313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-d3015210-7f79-4c27-b2f7-d1bf705329a0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:32.379678 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-d3015210-7f79-4c27-b2f7-d1bf705329a0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:32.387694 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-d3015210-7f79-4c27-b2f7-d1bf705329a0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1451 microversion: 2.1 time: 0.160773 Jun 27 15:38:32.388236 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 539/1079] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:32 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:32.404049 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-9dda7fc6-ea21-4c17-9f2f-5a4319027181 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:38:32.404799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-9dda7fc6-ea21-4c17-9f2f-5a4319027181 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:38:32.411526 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9dda7fc6-ea21-4c17-9f2f-5a4319027181 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:32.411973 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9dda7fc6-ea21-4c17-9f2f-5a4319027181 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:32.412774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9dda7fc6-ea21-4c17-9f2f-5a4319027181 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:32.413209 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-9dda7fc6-ea21-4c17-9f2f-5a4319027181 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:32.550686 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-9dda7fc6-ea21-4c17-9f2f-5a4319027181 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:38:32.562731 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-9dda7fc6-ea21-4c17-9f2f-5a4319027181 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1451 microversion: 2.1 time: 0.162318 Jun 27 15:38:32.563455 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 541/1080] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:38:32 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:38:34.513156 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-ac9df12b-a427-409f-ae10-2b6fd77e88f8 req-37e599e0-da77-4b9a-8bb2-39b4126fce4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3997d0-c146-403f-9249-e9c457819d36", "tag": "928d1e85-bf47-4f29-9eb6-61c0816e3e03"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:38:34.521867 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-ac9df12b-a427-409f-ae10-2b6fd77e88f8 req-37e599e0-da77-4b9a-8bb2-39b4126fce4d service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:38:34.522315 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-ac9df12b-a427-409f-ae10-2b6fd77e88f8 req-37e599e0-da77-4b9a-8bb2-39b4126fce4d service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:38:34.534352 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-ac9df12b-a427-409f-ae10-2b6fd77e88f8 req-37e599e0-da77-4b9a-8bb2-39b4126fce4d service nova] Creating event network-changed:928d1e85-bf47-4f29-9eb6-61c0816e3e03 for instance ab3997d0-c146-403f-9249-e9c457819d36 on hv-cinder-84779 Jun 27 15:38:34.540074 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-ac9df12b-a427-409f-ae10-2b6fd77e88f8 req-37e599e0-da77-4b9a-8bb2-39b4126fce4d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030679 Jun 27 15:38:34.540713 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 540/1081] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:38:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:09.099419 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=26 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:09.100171 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=62 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:09.106125 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-445770945", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-739718795", "security_groups": [{"name": "tempest-secgroup-smoke-1949080385"}], "block_device_mapping_v2": [{"uuid": "0537d329-70e0-42db-bbb3-d6ec20b7bf81", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "09bbc698-5eb1-420c-a302-7f9a1544cd53"}]}} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:09.246931 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.network.neutron [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] validate_networks() for [('09bbc698-5eb1-420c-a302-7f9a1544cd53', None, None, None, None, None)] {{(pid=117977) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 15:40:09.727971 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Flavor limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 15:40:09.728438 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Image limits 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 15:40:09.728911 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Flavor pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 15:40:09.729318 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Image pref 0:0:0 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 15:40:09.729720 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.virt.hardware [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117977) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 15:40:09.739327 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:09.739774 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:09.740598 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:09.741053 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:09.759051 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Getting quotas for project bf83328eefb741d086f33cd650fd3942. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 15:40:09.763276 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.quota [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Getting quotas for user 6401f2aaa0af4708953b42863aa25de0 and project bf83328eefb741d086f33cd650fd3942. Resources: {'ram', 'instances', 'cores'} {{(pid=117977) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 15:40:09.826021 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Going to run 1 instances... {{(pid=117977) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 15:40:09.828158 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0537d329-70e0-42db-bbb3-d6ec20b7bf81',volume_size=None,volume_type=None)] {{(pid=117977) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 15:40:09.971237 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f2c57015-4c38-459b-b6ff-247e08deecb5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.874855 Jun 27 15:40:09.971907 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 542/1082] 10.222.0.26 () {60 vars in 1146 bytes} [Mon Jun 27 15:40:09 2022] POST /compute/v2.1/servers => generated 406 bytes in 877 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 15:40:09.980627 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:09.981460 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:09.986959 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-2a8aee75-d14a-4c32-82ef-02616ffaa9d5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:09.987667 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-2a8aee75-d14a-4c32-82ef-02616ffaa9d5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:10.050520 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-2a8aee75-d14a-4c32-82ef-02616ffaa9d5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:10.058074 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-2a8aee75-d14a-4c32-82ef-02616ffaa9d5 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1093 microversion: 2.1 time: 0.079762 Jun 27 15:40:10.059036 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 541/1083] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:09 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1093 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:11.077089 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-3fe8d96c-8e39-4691-8384-499ee1f75927 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:11.078013 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-3fe8d96c-8e39-4691-8384-499ee1f75927 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:11.088481 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3fe8d96c-8e39-4691-8384-499ee1f75927 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:11.088928 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3fe8d96c-8e39-4691-8384-499ee1f75927 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:11.089708 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3fe8d96c-8e39-4691-8384-499ee1f75927 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:11.090139 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-3fe8d96c-8e39-4691-8384-499ee1f75927 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:11.152423 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-3fe8d96c-8e39-4691-8384-499ee1f75927 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:11.160421 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-3fe8d96c-8e39-4691-8384-499ee1f75927 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1209 microversion: 2.1 time: 0.088295 Jun 27 15:40:11.161045 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 543/1084] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:11 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1209 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:12.179677 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-4d522eee-b3a4-4cbb-a09c-9ac6f059a092 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:12.181050 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-4d522eee-b3a4-4cbb-a09c-9ac6f059a092 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:12.188801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d522eee-b3a4-4cbb-a09c-9ac6f059a092 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:12.189763 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d522eee-b3a4-4cbb-a09c-9ac6f059a092 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:12.190852 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d522eee-b3a4-4cbb-a09c-9ac6f059a092 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:12.191657 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-4d522eee-b3a4-4cbb-a09c-9ac6f059a092 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:12.382648 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-4d522eee-b3a4-4cbb-a09c-9ac6f059a092 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:12.390857 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-4d522eee-b3a4-4cbb-a09c-9ac6f059a092 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1265 microversion: 2.1 time: 0.217172 Jun 27 15:40:12.391367 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 542/1085] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:12 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1265 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:12.430121 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [req-c0c581c0-b3a3-4c46-888e-f8f31a9a4d8d req-36274551-6e19-4955-a45a-dbcc19b1f2dd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d22de4-fe9b-4216-a214-adc8bb03cb87", "tag": "6716d421-2168-4811-813c-2f62c8b1cb66"}]} {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:12.444658 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-c0c581c0-b3a3-4c46-888e-f8f31a9a4d8d req-36274551-6e19-4955-a45a-dbcc19b1f2dd service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:12.445523 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [req-c0c581c0-b3a3-4c46-888e-f8f31a9a4d8d req-36274551-6e19-4955-a45a-dbcc19b1f2dd service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:12.459279 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.compute.server_external_events [req-c0c581c0-b3a3-4c46-888e-f8f31a9a4d8d req-36274551-6e19-4955-a45a-dbcc19b1f2dd service nova] Creating event network-changed:6716d421-2168-4811-813c-2f62c8b1cb66 for instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 on hv-cinder-84779 Jun 27 15:40:12.462897 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR oslo.messaging._drivers.impl_rabbit [req-c0c581c0-b3a3-4c46-888e-f8f31a9a4d8d req-36274551-6e19-4955-a45a-dbcc19b1f2dd service nova] [3f7bbc0b-19b3-4004-8e0d-2db70e97201e] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jun 27 15:40:13.407854 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-dd0a594f-2817-4c27-80af-feae36fef56d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:13.408582 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-dd0a594f-2817-4c27-80af-feae36fef56d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:13.415781 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd0a594f-2817-4c27-80af-feae36fef56d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:13.416199 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd0a594f-2817-4c27-80af-feae36fef56d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:13.417086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd0a594f-2817-4c27-80af-feae36fef56d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:13.417420 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-dd0a594f-2817-4c27-80af-feae36fef56d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:13.471371 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO oslo.messaging._drivers.impl_rabbit [req-c0c581c0-b3a3-4c46-888e-f8f31a9a4d8d req-36274551-6e19-4955-a45a-dbcc19b1f2dd service nova] [3f7bbc0b-19b3-4004-8e0d-2db70e97201e] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 53456. Jun 27 15:40:13.481761 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [req-c0c581c0-b3a3-4c46-888e-f8f31a9a4d8d req-36274551-6e19-4955-a45a-dbcc19b1f2dd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.056493 Jun 27 15:40:13.482370 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 544/1086] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:40:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1059 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:13.614537 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-dd0a594f-2817-4c27-80af-feae36fef56d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:13.622447 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-dd0a594f-2817-4c27-80af-feae36fef56d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1265 microversion: 2.1 time: 0.218511 Jun 27 15:40:13.623061 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 543/1087] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:13 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1265 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:14.641483 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-de3aca62-61e9-479e-83cb-88b7a848effb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:14.642311 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-de3aca62-61e9-479e-83cb-88b7a848effb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:14.649133 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-de3aca62-61e9-479e-83cb-88b7a848effb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:14.649579 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-de3aca62-61e9-479e-83cb-88b7a848effb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:14.650362 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-de3aca62-61e9-479e-83cb-88b7a848effb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:14.650844 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-de3aca62-61e9-479e-83cb-88b7a848effb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:14.797298 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-de3aca62-61e9-479e-83cb-88b7a848effb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:14.806345 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-de3aca62-61e9-479e-83cb-88b7a848effb tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1265 microversion: 2.1 time: 0.170077 Jun 27 15:40:14.806909 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 545/1088] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:14 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:15.826035 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-f607bb7b-bba6-4d19-af32-707f7594601f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:15.826855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-f607bb7b-bba6-4d19-af32-707f7594601f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:15.836623 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f607bb7b-bba6-4d19-af32-707f7594601f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:15.837270 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f607bb7b-bba6-4d19-af32-707f7594601f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:15.838313 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f607bb7b-bba6-4d19-af32-707f7594601f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:15.838861 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-f607bb7b-bba6-4d19-af32-707f7594601f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:15.976608 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-f607bb7b-bba6-4d19-af32-707f7594601f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:15.984886 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-f607bb7b-bba6-4d19-af32-707f7594601f tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1265 microversion: 2.1 time: 0.164371 Jun 27 15:40:15.985444 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 544/1089] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:15 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:17.002144 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-f16a831c-3fb9-4945-85ce-8ffafbeb87c9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:17.002778 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-f16a831c-3fb9-4945-85ce-8ffafbeb87c9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:17.009662 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f16a831c-3fb9-4945-85ce-8ffafbeb87c9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:17.010115 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f16a831c-3fb9-4945-85ce-8ffafbeb87c9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:17.010888 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f16a831c-3fb9-4945-85ce-8ffafbeb87c9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:17.011314 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-f16a831c-3fb9-4945-85ce-8ffafbeb87c9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:17.155710 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-f16a831c-3fb9-4945-85ce-8ffafbeb87c9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:17.164734 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-f16a831c-3fb9-4945-85ce-8ffafbeb87c9 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1265 microversion: 2.1 time: 0.166553 Jun 27 15:40:17.165271 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 546/1090] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:16 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:18.182729 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-803ee8aa-5cb7-46e0-867f-570ab0cad0d1 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:18.183353 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-803ee8aa-5cb7-46e0-867f-570ab0cad0d1 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:18.191166 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-803ee8aa-5cb7-46e0-867f-570ab0cad0d1 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:18.191686 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-803ee8aa-5cb7-46e0-867f-570ab0cad0d1 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:18.192502 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-803ee8aa-5cb7-46e0-867f-570ab0cad0d1 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:18.192933 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-803ee8aa-5cb7-46e0-867f-570ab0cad0d1 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:18.331720 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-803ee8aa-5cb7-46e0-867f-570ab0cad0d1 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:18.339915 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-803ee8aa-5cb7-46e0-867f-570ab0cad0d1 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1265 microversion: 2.1 time: 0.161194 Jun 27 15:40:18.340547 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 545/1091] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:18 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:19.357321 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-2aa78b8c-979a-4086-b04f-8f093354ad36 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:19.357950 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-2aa78b8c-979a-4086-b04f-8f093354ad36 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:19.365379 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2aa78b8c-979a-4086-b04f-8f093354ad36 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:19.365823 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2aa78b8c-979a-4086-b04f-8f093354ad36 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:19.366587 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2aa78b8c-979a-4086-b04f-8f093354ad36 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:19.367022 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-2aa78b8c-979a-4086-b04f-8f093354ad36 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:19.514273 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-2aa78b8c-979a-4086-b04f-8f093354ad36 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:19.522231 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-2aa78b8c-979a-4086-b04f-8f093354ad36 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1265 microversion: 2.1 time: 0.168873 Jun 27 15:40:19.522808 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 547/1092] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:19 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:20.544899 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-22ee4148-cf05-45a1-8b2e-922aaf56c126 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:20.545519 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-22ee4148-cf05-45a1-8b2e-922aaf56c126 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:20.547893 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell0:SELECT=2 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:20.554185 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22ee4148-cf05-45a1-8b2e-922aaf56c126 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:20.554637 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22ee4148-cf05-45a1-8b2e-922aaf56c126 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:20.555414 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22ee4148-cf05-45a1-8b2e-922aaf56c126 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:20.555848 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-22ee4148-cf05-45a1-8b2e-922aaf56c126 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:20.696540 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-22ee4148-cf05-45a1-8b2e-922aaf56c126 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:20.704086 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-22ee4148-cf05-45a1-8b2e-922aaf56c126 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1265 microversion: 2.1 time: 0.163167 Jun 27 15:40:20.704688 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 546/1093] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:20 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:21.724556 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-b0f6270f-84eb-4e22-8549-a110973ea23d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:21.725211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-b0f6270f-84eb-4e22-8549-a110973ea23d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:21.727105 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=2 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:21.727785 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell0:SELECT=6 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:40:21.734132 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b0f6270f-84eb-4e22-8549-a110973ea23d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:21.734578 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b0f6270f-84eb-4e22-8549-a110973ea23d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:21.735346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b0f6270f-84eb-4e22-8549-a110973ea23d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:21.735779 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-b0f6270f-84eb-4e22-8549-a110973ea23d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:21.868692 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-b0f6270f-84eb-4e22-8549-a110973ea23d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:21.876366 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-b0f6270f-84eb-4e22-8549-a110973ea23d tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1265 microversion: 2.1 time: 0.158054 Jun 27 15:40:21.876922 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 548/1094] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:21 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:22.716225 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-d12b7fb0-5898-4caa-96b8-a2b92e8c1041 req-dc31e910-afa1-4bbe-a49b-693bbbdf44e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d22de4-fe9b-4216-a214-adc8bb03cb87", "name": "network-vif-plugged", "status": "completed", "tag": "6716d421-2168-4811-813c-2f62c8b1cb66"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:22.726418 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d12b7fb0-5898-4caa-96b8-a2b92e8c1041 req-dc31e910-afa1-4bbe-a49b-693bbbdf44e8 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:22.726937 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-d12b7fb0-5898-4caa-96b8-a2b92e8c1041 req-dc31e910-afa1-4bbe-a49b-693bbbdf44e8 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:22.738577 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-d12b7fb0-5898-4caa-96b8-a2b92e8c1041 req-dc31e910-afa1-4bbe-a49b-693bbbdf44e8 service nova] Creating event network-vif-plugged:6716d421-2168-4811-813c-2f62c8b1cb66 for instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 on hv-cinder-84779 Jun 27 15:40:22.743994 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-d12b7fb0-5898-4caa-96b8-a2b92e8c1041 req-dc31e910-afa1-4bbe-a49b-693bbbdf44e8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031824 Jun 27 15:40:22.744626 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 547/1095] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:40:22.894292 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-5895c5d9-648a-4bd2-b1fc-9f7c8c352215 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:22.895005 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-5895c5d9-648a-4bd2-b1fc-9f7c8c352215 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:22.902046 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5895c5d9-648a-4bd2-b1fc-9f7c8c352215 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:22.902589 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5895c5d9-648a-4bd2-b1fc-9f7c8c352215 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:22.903365 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5895c5d9-648a-4bd2-b1fc-9f7c8c352215 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:22.903803 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-5895c5d9-648a-4bd2-b1fc-9f7c8c352215 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:23.038963 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-5895c5d9-648a-4bd2-b1fc-9f7c8c352215 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:23.049693 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-5895c5d9-648a-4bd2-b1fc-9f7c8c352215 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1265 microversion: 2.1 time: 0.159106 Jun 27 15:40:23.050813 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 549/1096] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:22 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:24.067605 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-5aa6f447-93ed-4a96-98ef-417d7cb2edd6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:24.068308 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-5aa6f447-93ed-4a96-98ef-417d7cb2edd6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:24.076339 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa6f447-93ed-4a96-98ef-417d7cb2edd6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:24.076802 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa6f447-93ed-4a96-98ef-417d7cb2edd6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:24.077594 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa6f447-93ed-4a96-98ef-417d7cb2edd6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:24.078032 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-5aa6f447-93ed-4a96-98ef-417d7cb2edd6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:24.229613 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-5aa6f447-93ed-4a96-98ef-417d7cb2edd6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:24.237730 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-5aa6f447-93ed-4a96-98ef-417d7cb2edd6 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1452 microversion: 2.1 time: 0.174378 Jun 27 15:40:24.238319 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 548/1097] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:24 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1452 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:24.255110 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-1c7ed5b3-a036-493c-9ac6-7b60cca17ee0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:40:24.255724 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-1c7ed5b3-a036-493c-9ac6-7b60cca17ee0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:40:24.262589 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1c7ed5b3-a036-493c-9ac6-7b60cca17ee0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:24.262977 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1c7ed5b3-a036-493c-9ac6-7b60cca17ee0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:24.263754 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1c7ed5b3-a036-493c-9ac6-7b60cca17ee0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:24.264211 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-1c7ed5b3-a036-493c-9ac6-7b60cca17ee0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:24.417939 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-1c7ed5b3-a036-493c-9ac6-7b60cca17ee0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:40:24.429059 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-1c7ed5b3-a036-493c-9ac6-7b60cca17ee0 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1452 microversion: 2.1 time: 0.177429 Jun 27 15:40:24.430065 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 550/1098] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:40:24 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:40:26.182697 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-b595b7b0-fe51-478b-ab92-98999c79f31b req-26517151-0e31-4c97-a4a3-2d31f2c26a9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d22de4-fe9b-4216-a214-adc8bb03cb87", "tag": "6716d421-2168-4811-813c-2f62c8b1cb66"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:40:26.191906 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-b595b7b0-fe51-478b-ab92-98999c79f31b req-26517151-0e31-4c97-a4a3-2d31f2c26a9f service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:40:26.192485 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-b595b7b0-fe51-478b-ab92-98999c79f31b req-26517151-0e31-4c97-a4a3-2d31f2c26a9f service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:40:26.209442 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-b595b7b0-fe51-478b-ab92-98999c79f31b req-26517151-0e31-4c97-a4a3-2d31f2c26a9f service nova] Creating event network-changed:6716d421-2168-4811-813c-2f62c8b1cb66 for instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 on hv-cinder-84779 Jun 27 15:40:26.214842 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-b595b7b0-fe51-478b-ab92-98999c79f31b req-26517151-0e31-4c97-a4a3-2d31f2c26a9f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036007 Jun 27 15:40:26.215818 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 549/1099] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:44.894908 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:41:44.895553 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Mon Jun 27 15:41:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:41:56.431266 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:41:56.432571 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG dbcounter [-] [117977] Writing DB stats nova_cell1:SELECT=46 {{(pid=117977) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:41:56.434048 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_api:SELECT=20 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:41:56.435046 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG dbcounter [-] [117978] Writing DB stats nova_cell1:SELECT=40 {{(pid=117978) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 15:41:56.436793 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-dc226603-921e-4687-a79a-96ca2656f958 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:56.437443 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-dc226603-921e-4687-a79a-96ca2656f958 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:41:56.441112 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-14803604-92f9-4db0-9148-2618390b54e4 req-1b4a1215-ecd7-4f2c-b164-b8d597f48c39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24d22de4-fe9b-4216-a214-adc8bb03cb87", "tag": "6716d421-2168-4811-813c-2f62c8b1cb66"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:56.444991 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dc226603-921e-4687-a79a-96ca2656f958 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:56.445668 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dc226603-921e-4687-a79a-96ca2656f958 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:56.446463 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dc226603-921e-4687-a79a-96ca2656f958 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:56.447092 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-dc226603-921e-4687-a79a-96ca2656f958 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:56.452302 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-14803604-92f9-4db0-9148-2618390b54e4 req-1b4a1215-ecd7-4f2c-b164-b8d597f48c39 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:56.452795 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-14803604-92f9-4db0-9148-2618390b54e4 req-1b4a1215-ecd7-4f2c-b164-b8d597f48c39 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:56.464218 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-14803604-92f9-4db0-9148-2618390b54e4 req-1b4a1215-ecd7-4f2c-b164-b8d597f48c39 service nova] Creating event network-changed:6716d421-2168-4811-813c-2f62c8b1cb66 for instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 on hv-cinder-84779 Jun 27 15:41:56.469717 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-14803604-92f9-4db0-9148-2618390b54e4 req-1b4a1215-ecd7-4f2c-b164-b8d597f48c39 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038156 Jun 27 15:41:56.470318 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 550/1100] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:41:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:56.474698 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-dc226603-921e-4687-a79a-96ca2656f958 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Going to try to terminate instance {{(pid=117977) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:41:56.570715 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-dc226603-921e-4687-a79a-96ca2656f958 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 204 len: 0 microversion: 2.1 time: 0.140934 Jun 27 15:41:56.571408 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 551/1101] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:41:56 2022] DELETE /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:41:56.580920 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-ad53fcd7-2ea6-4676-ba0f-ce9a59633839 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:56.581612 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-ad53fcd7-2ea6-4676-ba0f-ce9a59633839 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:41:56.588273 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad53fcd7-2ea6-4676-ba0f-ce9a59633839 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:56.588897 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad53fcd7-2ea6-4676-ba0f-ce9a59633839 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:56.589767 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad53fcd7-2ea6-4676-ba0f-ce9a59633839 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:56.590297 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-ad53fcd7-2ea6-4676-ba0f-ce9a59633839 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:56.822058 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-ad53fcd7-2ea6-4676-ba0f-ce9a59633839 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:41:56.830708 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-ad53fcd7-2ea6-4676-ba0f-ce9a59633839 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1577 microversion: 2.1 time: 0.254440 Jun 27 15:41:56.831346 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 551/1102] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:41:56 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1577 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:41:57.850709 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-10376cec-5d18-45ed-bcd1-0c93fc306c75 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:57.851686 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-10376cec-5d18-45ed-bcd1-0c93fc306c75 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:41:57.861601 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-10376cec-5d18-45ed-bcd1-0c93fc306c75 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:57.862053 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-10376cec-5d18-45ed-bcd1-0c93fc306c75 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:57.862831 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-10376cec-5d18-45ed-bcd1-0c93fc306c75 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:57.863269 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-10376cec-5d18-45ed-bcd1-0c93fc306c75 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:58.072804 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-10376cec-5d18-45ed-bcd1-0c93fc306c75 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:41:58.081401 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-10376cec-5d18-45ed-bcd1-0c93fc306c75 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1577 microversion: 2.1 time: 0.235444 Jun 27 15:41:58.081979 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 552/1103] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:41:57 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1577 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:41:58.618654 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-2c9b15d1-1066-4384-8bb4-17e74db940e2 req-f1afe6cc-91a3-4807-adea-8973ead69d75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24d22de4-fe9b-4216-a214-adc8bb03cb87", "name": "network-vif-deleted", "tag": "6716d421-2168-4811-813c-2f62c8b1cb66"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:41:58.627823 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-2c9b15d1-1066-4384-8bb4-17e74db940e2 req-f1afe6cc-91a3-4807-adea-8973ead69d75 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:58.628253 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-2c9b15d1-1066-4384-8bb4-17e74db940e2 req-f1afe6cc-91a3-4807-adea-8973ead69d75 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:58.642079 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-2c9b15d1-1066-4384-8bb4-17e74db940e2 req-f1afe6cc-91a3-4807-adea-8973ead69d75 service nova] Creating event network-vif-deleted:6716d421-2168-4811-813c-2f62c8b1cb66 for instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 on hv-cinder-84779 Jun 27 15:41:58.646861 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-2c9b15d1-1066-4384-8bb4-17e74db940e2 req-f1afe6cc-91a3-4807-adea-8973ead69d75 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031919 Jun 27 15:41:58.647453 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 552/1104] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:41:59.100079 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:41:59.100760 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:41:59.107796 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:59.108248 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:59.110526 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:59.110526 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:59.149105 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:41:59.149435 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:41:59.149875 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.objects.instance [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lazy-loading 'fault' on Instance uuid 24d22de4-fe9b-4216-a214-adc8bb03cb87 {{(pid=117977) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 15:41:59.202630 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:41:59.211278 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-332dad17-2a75-4dfe-ad41-42f4b1068174 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 200 len: 1229 microversion: 2.1 time: 0.116043 Jun 27 15:41:59.212078 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 553/1105] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:41:59 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 1229 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:42:00.234030 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9e271f55-47a8-4aef-a5e0-4595c23d4de8 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:00.234992 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-9e271f55-47a8-4aef-a5e0-4595c23d4de8 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: 24d22de4-fe9b-4216-a214-adc8bb03cb87] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:42:00.242100 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e271f55-47a8-4aef-a5e0-4595c23d4de8 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:00.242552 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e271f55-47a8-4aef-a5e0-4595c23d4de8 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:00.243326 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e271f55-47a8-4aef-a5e0-4595c23d4de8 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:00.243761 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-9e271f55-47a8-4aef-a5e0-4595c23d4de8 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:00.257355 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-9e271f55-47a8-4aef-a5e0-4595c23d4de8 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] HTTP exception thrown: Instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 could not be found. Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9e271f55-47a8-4aef-a5e0-4595c23d4de8 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Request method failure captured: Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 HTTP/1.1 Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiuc49LaC3CfqiDNUcEhMMEiDes_vu4itqAxygHbtT1STdwMsPJKgNPmcH3UPPsGojANdAp4t8GgQtvfI-v-Sxeeq4vvvWHQeT0XMDIf1JrQb1knVT7RjoKMM_pjeq3ch6XEC8KP36PKyU13CnCxbWacU4yszvzfmwNI2fnKh4a5NjS8s Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: bf83328eefb741d086f33cd650fd3942 Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:42:00.259026 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bf83328eefb741d086f33cd650fd3942", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: bf83328eefb741d086f33cd650fd3942 Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-TestVolumeBootPattern-442144854-project Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 6401f2aaa0af4708953b42863aa25de0 Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-TestVolumeBootPattern-442144854-project Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 could not be found. Jun 27 15:42:00.260797 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': '24d22de4-fe9b-4216-a214-adc8bb03cb87'} Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 could not be found. Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:42:00.261760 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 could not be found. Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 could not be found. Jun 27 15:42:00.263408 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:42:00.264953 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-9e271f55-47a8-4aef-a5e0-4595c23d4de8 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Returning 404 to user: Instance 24d22de4-fe9b-4216-a214-adc8bb03cb87 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:42:00.264953 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-9e271f55-47a8-4aef-a5e0-4595c23d4de8 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87" status: 404 len: 111 microversion: 2.1 time: 0.031178 Jun 27 15:42:00.264953 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 553/1106] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:42:00 2022] GET /compute/v2.1/servers/24d22de4-fe9b-4216-a214-adc8bb03cb87 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:42:03.646780 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-92466d62-8b9b-4e67-9de0-dfc1d7b54646 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:03.647432 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-92466d62-8b9b-4e67-9de0-dfc1d7b54646 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:42:03.648432 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-e09f3692-c347-487b-acb0-8af975b21caa req-ca5cfb6f-7120-4592-8054-21561ce8212a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ab3997d0-c146-403f-9249-e9c457819d36", "tag": "928d1e85-bf47-4f29-9eb6-61c0816e3e03"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:42:03.654417 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-92466d62-8b9b-4e67-9de0-dfc1d7b54646 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:03.655037 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-92466d62-8b9b-4e67-9de0-dfc1d7b54646 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:03.655695 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-92466d62-8b9b-4e67-9de0-dfc1d7b54646 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:03.656128 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-92466d62-8b9b-4e67-9de0-dfc1d7b54646 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:03.657254 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-e09f3692-c347-487b-acb0-8af975b21caa req-ca5cfb6f-7120-4592-8054-21561ce8212a service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:03.657965 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-e09f3692-c347-487b-acb0-8af975b21caa req-ca5cfb6f-7120-4592-8054-21561ce8212a service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:03.670421 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-e09f3692-c347-487b-acb0-8af975b21caa req-ca5cfb6f-7120-4592-8054-21561ce8212a service nova] Creating event network-changed:928d1e85-bf47-4f29-9eb6-61c0816e3e03 for instance ab3997d0-c146-403f-9249-e9c457819d36 on hv-cinder-84779 Jun 27 15:42:03.676380 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-e09f3692-c347-487b-acb0-8af975b21caa req-ca5cfb6f-7120-4592-8054-21561ce8212a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031695 Jun 27 15:42:03.680447 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 554/1107] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:42:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:42:03.691151 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-92466d62-8b9b-4e67-9de0-dfc1d7b54646 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Going to try to terminate instance {{(pid=117977) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 15:42:03.777594 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-92466d62-8b9b-4e67-9de0-dfc1d7b54646 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "DELETE /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 204 len: 0 microversion: 2.1 time: 0.135654 Jun 27 15:42:03.781588 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 554/1108] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:42:03 2022] DELETE /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 15:42:03.788579 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a5e16f84-9136-4642-bf6f-004957393216 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:03.789620 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-a5e16f84-9136-4642-bf6f-004957393216 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:42:03.796016 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5e16f84-9136-4642-bf6f-004957393216 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:03.796923 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5e16f84-9136-4642-bf6f-004957393216 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:03.798210 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5e16f84-9136-4642-bf6f-004957393216 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:03.798667 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-a5e16f84-9136-4642-bf6f-004957393216 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:03.942785 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.policy [None req-a5e16f84-9136-4642-bf6f-004957393216 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117978) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:42:03.950676 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a5e16f84-9136-4642-bf6f-004957393216 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1574 microversion: 2.1 time: 0.167323 Jun 27 15:42:03.951331 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 555/1109] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:42:03 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1574 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 15:42:04.970050 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-ba5bea4a-b758-4567-b92a-5848964fadd3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:04.970901 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-ba5bea4a-b758-4567-b92a-5848964fadd3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:42:04.978881 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ba5bea4a-b758-4567-b92a-5848964fadd3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:04.979338 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ba5bea4a-b758-4567-b92a-5848964fadd3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:04.980107 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ba5bea4a-b758-4567-b92a-5848964fadd3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:04.980729 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-ba5bea4a-b758-4567-b92a-5848964fadd3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:05.326208 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.policy [None req-ba5bea4a-b758-4567-b92a-5848964fadd3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6401f2aaa0af4708953b42863aa25de0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bf83328eefb741d086f33cd650fd3942', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117977) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 15:42:05.335392 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-ba5bea4a-b758-4567-b92a-5848964fadd3 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 200 len: 1574 microversion: 2.1 time: 0.369838 Jun 27 15:42:05.340431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 555/1110] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:42:04 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 1574 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 15:42:05.714646 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [req-1c0e807f-a902-4493-8822-1dd204646726 req-654aeb30-1f88-4c84-81aa-aaa2b676a582 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ab3997d0-c146-403f-9249-e9c457819d36", "name": "network-vif-deleted", "tag": "928d1e85-bf47-4f29-9eb6-61c0816e3e03"}]} {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 15:42:05.724608 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-1c0e807f-a902-4493-8822-1dd204646726 req-654aeb30-1f88-4c84-81aa-aaa2b676a582 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:05.725049 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [req-1c0e807f-a902-4493-8822-1dd204646726 req-654aeb30-1f88-4c84-81aa-aaa2b676a582 service nova] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:05.737510 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.compute.server_external_events [req-1c0e807f-a902-4493-8822-1dd204646726 req-654aeb30-1f88-4c84-81aa-aaa2b676a582 service nova] Creating event network-vif-deleted:928d1e85-bf47-4f29-9eb6-61c0816e3e03 for instance ab3997d0-c146-403f-9249-e9c457819d36 on hv-cinder-84779 Jun 27 15:42:05.742702 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [req-1c0e807f-a902-4493-8822-1dd204646726 req-654aeb30-1f88-4c84-81aa-aaa2b676a582 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031770 Jun 27 15:42:05.743307 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 556/1111] 10.222.0.26 () {64 vars in 1317 bytes} [Mon Jun 27 15:42:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 15:42:06.353056 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8550875c-f4f4-4a14-a1b7-8ab4f4d359c4 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:06.353784 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-8550875c-f4f4-4a14-a1b7-8ab4f4d359c4 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: ab3997d0-c146-403f-9249-e9c457819d36] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:42:06.360894 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8550875c-f4f4-4a14-a1b7-8ab4f4d359c4 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:06.361289 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8550875c-f4f4-4a14-a1b7-8ab4f4d359c4 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:06.362375 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8550875c-f4f4-4a14-a1b7-8ab4f4d359c4 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:06.362799 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-8550875c-f4f4-4a14-a1b7-8ab4f4d359c4 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:06.377999 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-8550875c-f4f4-4a14-a1b7-8ab4f4d359c4 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] HTTP exception thrown: Instance ab3997d0-c146-403f-9249-e9c457819d36 could not be found. Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8550875c-f4f4-4a14-a1b7-8ab4f4d359c4 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Request method failure captured: Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 HTTP/1.1 Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiuc49LaC3CfqiDNUcEhMMEiDes_vu4itqAxygHbtT1STdwMsPJKgNPmcH3UPPsGojANdAp4t8GgQtvfI-v-Sxeeq4vvvWHQeT0XMDIf1JrQb1knVT7RjoKMM_pjeq3ch6XEC8KP36PKyU13CnCxbWacU4yszvzfmwNI2fnKh4a5NjS8s Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: bf83328eefb741d086f33cd650fd3942 Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:42:06.379727 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bf83328eefb741d086f33cd650fd3942", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: bf83328eefb741d086f33cd650fd3942 Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-TestVolumeBootPattern-442144854-project Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 6401f2aaa0af4708953b42863aa25de0 Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-TestVolumeBootPattern-442144854-project Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance ab3997d0-c146-403f-9249-e9c457819d36 could not be found. Jun 27 15:42:06.381988 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'ab3997d0-c146-403f-9249-e9c457819d36'} Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ab3997d0-c146-403f-9249-e9c457819d36 could not be found. Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:42:06.383085 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ab3997d0-c146-403f-9249-e9c457819d36 could not be found. Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ab3997d0-c146-403f-9249-e9c457819d36 could not be found. Jun 27 15:42:06.384914 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.386469 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-8550875c-f4f4-4a14-a1b7-8ab4f4d359c4 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Returning 404 to user: Instance ab3997d0-c146-403f-9249-e9c457819d36 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:42:06.386469 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-8550875c-f4f4-4a14-a1b7-8ab4f4d359c4 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36" status: 404 len: 111 microversion: 2.1 time: 0.032221 Jun 27 15:42:06.386469 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 556/1112] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:42:06 2022] GET /compute/v2.1/servers/ab3997d0-c146-403f-9249-e9c457819d36 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:42:06.880487 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1bd165d6-816b-410e-b2a0-3805667266bd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:06.881695 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.compute.api [None req-1bd165d6-816b-410e-b2a0-3805667266bd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117978) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:42:06.891153 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bd165d6-816b-410e-b2a0-3805667266bd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:06.891732 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bd165d6-816b-410e-b2a0-3805667266bd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:06.893110 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bd165d6-816b-410e-b2a0-3805667266bd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:06.893822 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG oslo_concurrency.lockutils [None req-1bd165d6-816b-410e-b2a0-3805667266bd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117978) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:06.911994 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.wsgi [None req-1bd165d6-816b-410e-b2a0-3805667266bd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] HTTP exception thrown: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1bd165d6-816b-410e-b2a0-3805667266bd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Request method failure captured: Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: request: DELETE /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 HTTP/1.1 Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept: application/json Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Accept-Encoding: identity Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Connection: close Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Length: 0 Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Content-Type: application/json Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Host: 10.222.0.26 Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Openstack-System-Scope: None Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: User-Agent: python-urllib3/1.26.9 Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Auth-Token: gAAAAABiuc49LaC3CfqiDNUcEhMMEiDes_vu4itqAxygHbtT1STdwMsPJKgNPmcH3UPPsGojANdAp4t8GgQtvfI-v-Sxeeq4vvvWHQeT0XMDIf1JrQb1knVT7RjoKMM_pjeq3ch6XEC8KP36PKyU13CnCxbWacU4yszvzfmwNI2fnKh4a5NjS8s Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Id: None Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Domain-Name: None Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Identity-Status: Confirmed Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Is-Admin-Project: True Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Id: default Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Domain-Name: Default Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Id: bf83328eefb741d086f33cd650fd3942 Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Project-Name: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Role: reader,member Jun 27 15:42:06.915012 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Roles: reader,member Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bf83328eefb741d086f33cd650fd3942", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Id: bf83328eefb741d086f33cd650fd3942 Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-Tenant-Name: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User: tempest-TestVolumeBootPattern-442144854-project Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Id: default Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Domain-Name: Default Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Id: 6401f2aaa0af4708953b42863aa25de0 Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: X-User-Name: tempest-TestVolumeBootPattern-442144854-project Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: method: > Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: exception: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:42:06.916855 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: action_args: {'id': 'c64daf70-81db-49be-8de8-4900c3f76376'} Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:42:06.917816 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:42:06.919227 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.920856 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-1bd165d6-816b-410e-b2a0-3805667266bd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Returning 404 to user: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. {{(pid=117978) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:42:06.920856 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-1bd165d6-816b-410e-b2a0-3805667266bd tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 404 len: 111 microversion: 2.1 time: 0.046324 Jun 27 15:42:06.920856 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 557/1113] 10.222.0.26 () {58 vars in 1238 bytes} [Mon Jun 27 15:42:06 2022] DELETE /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:42:06.929431 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a5e2a448-2955-4285-8f23-c0719a74aa18 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '>' {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:06.930374 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.compute.api [None req-a5e2a448-2955-4285-8f23-c0719a74aa18 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] [instance: c64daf70-81db-49be-8de8-4900c3f76376] Fetching instance by UUID {{(pid=117977) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 15:42:06.942158 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a5e2a448-2955-4285-8f23-c0719a74aa18 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:06.942682 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a5e2a448-2955-4285-8f23-c0719a74aa18 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:06.943976 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a5e2a448-2955-4285-8f23-c0719a74aa18 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 15:42:06.944682 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG oslo_concurrency.lockutils [None req-a5e2a448-2955-4285-8f23-c0719a74aa18 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Lock "3576ccde-37ef-449d-b98e-5672f36557b1" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117977) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 15:42:06.962633 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.wsgi [None req-a5e2a448-2955-4285-8f23-c0719a74aa18 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] HTTP exception thrown: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a5e2a448-2955-4285-8f23-c0719a74aa18 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Request method failure captured: Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: request: GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 HTTP/1.1 Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept: application/json Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Accept-Encoding: identity Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Connection: close Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Length: 0 Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Content-Type: application/json Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Host: 10.222.0.26 Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Openstack-System-Scope: None Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: User-Agent: python-urllib3/1.26.9 Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Auth-Token: gAAAAABiuc49LaC3CfqiDNUcEhMMEiDes_vu4itqAxygHbtT1STdwMsPJKgNPmcH3UPPsGojANdAp4t8GgQtvfI-v-Sxeeq4vvvWHQeT0XMDIf1JrQb1knVT7RjoKMM_pjeq3ch6XEC8KP36PKyU13CnCxbWacU4yszvzfmwNI2fnKh4a5NjS8s Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Id: None Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Domain-Name: None Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Identity-Status: Confirmed Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Is-Admin-Project: True Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Id: default Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Domain-Name: Default Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Id: bf83328eefb741d086f33cd650fd3942 Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Project-Name: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Role: reader,member Jun 27 15:42:06.964387 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Roles: reader,member Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_bf83328eefb741d086f33cd650fd3942", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/bf83328eefb741d086f33cd650fd3942"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}] Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Id: bf83328eefb741d086f33cd650fd3942 Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-Tenant-Name: tempest-TestVolumeBootPattern-442144854 Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User: tempest-TestVolumeBootPattern-442144854-project Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Id: default Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Domain-Name: Default Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Id: 6401f2aaa0af4708953b42863aa25de0 Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: X-User-Name: tempest-TestVolumeBootPattern-442144854-project Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: method: > Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: exception: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:42:06.966386 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: action_args: {'id': 'c64daf70-81db-49be-8de8-4900c3f76376'} Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: {{(pid=117977) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 15:42:06.967355 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. Jun 27 15:42:06.968918 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: ERROR nova.api.openstack.wsgi Jun 27 15:42:06.970346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: DEBUG nova.api.openstack.wsgi [None req-a5e2a448-2955-4285-8f23-c0719a74aa18 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Returning 404 to user: Instance c64daf70-81db-49be-8de8-4900c3f76376 could not be found. {{(pid=117977) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 15:42:06.970346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO nova.api.openstack.requestlog [None req-a5e2a448-2955-4285-8f23-c0719a74aa18 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376" status: 404 len: 111 microversion: 2.1 time: 0.043321 Jun 27 15:42:06.970346 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: [pid: 117977|app: 0|req: 557/1114] 10.222.0.26 () {58 vars in 1235 bytes} [Mon Jun 27 15:42:06 2022] GET /compute/v2.1/servers/c64daf70-81db-49be-8de8-4900c3f76376 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 15:42:08.295255 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: DEBUG nova.api.openstack.wsgi [None req-a49b12e1-3188-4159-bdc6-baec04166636 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] Calling method '.version_select at 0x7fb27820bee0>' {{(pid=117978) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 15:42:08.320754 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO nova.api.openstack.requestlog [None req-a49b12e1-3188-4159-bdc6-baec04166636 tempest-TestVolumeBootPattern-442144854 tempest-TestVolumeBootPattern-442144854-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-739718795" status: 202 len: 0 microversion: 2.1 time: 0.028957 Jun 27 15:42:08.322006 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: [pid: 117978|app: 0|req: 558/1115] 10.222.0.26 () {58 vars in 1259 bytes} [Mon Jun 27 15:42:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-739718795 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 15:43:16.941882 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:43:16.942628 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Mon Jun 27 15:43:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:43:18.649465 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:43:18.650438 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Mon Jun 27 15:43:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:43:25.685653 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:43:25.686725 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Mon Jun 27 15:43:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:45:04.905043 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:45:04.905772 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Mon Jun 27 15:45:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:45:25.499683 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:45:25.501790 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Mon Jun 27 15:45:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:46:36.952782 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:46:36.953801 dv-cinder-847798-1-iscsi devstack@n-api.service[117978]: Mon Jun 27 15:46:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:46:38.662983 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:46:38.663922 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Mon Jun 27 15:46:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:46:45.701378 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:46:45.702241 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Mon Jun 27 15:46:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 15:47:04.800233 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 15:47:04.801456 dv-cinder-847798-1-iscsi devstack@n-api.service[117977]: Mon Jun 27 15:47:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!